-- Logs begin at Wed 2022-08-24 15:58:19 UTC, end at Wed 2022-08-24 16:56:37 UTC. -- Aug 24 16:25:00.349690 dv-cinder-852208-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 16:25:00.361231 dv-cinder-852208-9-smb devstack@keystone.service[81497]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 16:25:00.364011 dv-cinder-852208-9-smb devstack@keystone.service[81497]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:25:00 2022] *** Aug 24 16:25:00.364208 dv-cinder-852208-9-smb devstack@keystone.service[81497]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:25:00.364365 dv-cinder-852208-9-smb devstack@keystone.service[81497]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:25:00.364533 dv-cinder-852208-9-smb devstack@keystone.service[81497]: nodename: dv-cinder-852208-9-smb Aug 24 16:25:00.364701 dv-cinder-852208-9-smb devstack@keystone.service[81497]: machine: x86_64 Aug 24 16:25:00.364842 dv-cinder-852208-9-smb devstack@keystone.service[81497]: clock source: unix Aug 24 16:25:00.364968 dv-cinder-852208-9-smb devstack@keystone.service[81497]: pcre jit disabled Aug 24 16:25:00.365087 dv-cinder-852208-9-smb devstack@keystone.service[81497]: detected number of CPU cores: 4 Aug 24 16:25:00.365204 dv-cinder-852208-9-smb devstack@keystone.service[81497]: current working directory: / Aug 24 16:25:00.365333 dv-cinder-852208-9-smb devstack@keystone.service[81497]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:25:00.365467 dv-cinder-852208-9-smb devstack@keystone.service[81497]: your processes number limit is 47680 Aug 24 16:25:00.365596 dv-cinder-852208-9-smb devstack@keystone.service[81497]: your memory page size is 4096 bytes Aug 24 16:25:00.365725 dv-cinder-852208-9-smb devstack@keystone.service[81497]: detected max file descriptor number: 2048 Aug 24 16:25:00.365866 dv-cinder-852208-9-smb devstack@keystone.service[81497]: lock engine: pthread robust mutexes Aug 24 16:25:00.366142 dv-cinder-852208-9-smb devstack@keystone.service[81497]: thunder lock: enabled Aug 24 16:25:00.366459 dv-cinder-852208-9-smb devstack@keystone.service[81497]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 16:25:00.366669 dv-cinder-852208-9-smb devstack@keystone.service[81497]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:25:00.405802 dv-cinder-852208-9-smb devstack@keystone.service[81497]: Python main interpreter initialized at 0x55fa1c4a99c0 Aug 24 16:25:00.405802 dv-cinder-852208-9-smb devstack@keystone.service[81497]: python threads support enabled Aug 24 16:25:00.405802 dv-cinder-852208-9-smb devstack@keystone.service[81497]: your server socket listen backlog is limited to 100 connections Aug 24 16:25:00.405802 dv-cinder-852208-9-smb devstack@keystone.service[81497]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:25:00.406145 dv-cinder-852208-9-smb devstack@keystone.service[81497]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:25:00.406239 dv-cinder-852208-9-smb devstack@keystone.service[81497]: *** Operational MODE: preforking *** Aug 24 16:25:00.406529 dv-cinder-852208-9-smb devstack@keystone.service[81497]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:25:00.406529 dv-cinder-852208-9-smb devstack@keystone.service[81497]: spawned uWSGI master process (pid: 81497) Aug 24 16:25:00.406710 dv-cinder-852208-9-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 16:25:00.408161 dv-cinder-852208-9-smb devstack@keystone.service[81497]: spawned uWSGI worker 1 (pid: 81534, cores: 1) Aug 24 16:25:00.408263 dv-cinder-852208-9-smb devstack@keystone.service[81497]: spawned uWSGI worker 2 (pid: 81535, cores: 1) Aug 24 16:25:00.408402 dv-cinder-852208-9-smb devstack@keystone.service[81497]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:25:04.666597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:25:04.666597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: from cryptography.utils import int_from_bytes Aug 24 16:25:04.667373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:25:04.667373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: from cryptography.utils import int_from_bytes Aug 24 16:25:04.674669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:25:04.674669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: from cryptography.utils import int_from_bytes Aug 24 16:25:04.675161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:25:04.675161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: from cryptography.utils import int_from_bytes Aug 24 16:25:04.721578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:25:04.721808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:25:04.721955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] command line args: [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:25:04.722220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:25:04.722378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ================================================================================ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:25:04.722656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] admin_token = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.722901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config_dir = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.723060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.723271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] config_source = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.723448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] debug = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.723709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.724086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.724246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.724480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.724756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.724965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.725144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_config_append = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.725315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.725523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_dir = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.725709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.725916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.726169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.726415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.726652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.726849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.727020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.727266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.727455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:25:04.727547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.727655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:25:04.727756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.727842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] command line args: [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:25:04.727987 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.728143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:25:04.728233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.728311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ================================================================================ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:25:04.728425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.728583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] admin_token = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.728664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.728835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config_dir = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.728917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729301 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] config_source = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] debug = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.729899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] publish_errors = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.730056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.730144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.730290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.730474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.730597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.730707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.730959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.731049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.731181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] standard_threads = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.731395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.731477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.731674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.731766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_config_append = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.731845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_journal = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_json = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_stderr = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_dir = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] use_syslog = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.732849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.733011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.733097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.733242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.733326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.733506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.733582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.733749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.733832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.733930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.734005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.734113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.734225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.734368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.734476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.734623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.734701 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.734866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.734951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.735105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.735182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.735343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.735421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.735592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.735727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.735852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.735980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.736105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.736226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.736384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.736469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.736708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.736884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.736968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.737051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] publish_errors = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.737188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.737294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.737446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.737524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.737693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.737778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.737932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.738009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.738169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.738243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.738407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] standard_threads = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.738497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.738643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.738721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.738893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.738970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.739120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.739245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.739415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.739671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.739853 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_journal = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.739930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.740054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_json = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.740147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.740228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_stderr = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.740382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.740464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] use_syslog = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.740616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.740698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:25:04.740851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.740939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.741902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742360 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.742992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.743974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.744989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.745937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.746860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747752 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.747991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.748978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.749955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.750986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.751119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.751554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.751721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.751815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.751964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.752976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.753964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.754088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.754165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.754324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.754399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.754562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.754640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.754827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755508 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.755983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.756061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.756225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.756304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.756458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.756537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.756698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.756934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.757936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.external = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.758926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.759056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.759160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.759297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.759393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.password = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.759545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.759790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.759868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] auth.token = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.760857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.761968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.762938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.763918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.764951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.765916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.766893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.external = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.767903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.password = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] auth.token = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.768833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.769948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.770026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.770185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.770265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.770491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.770840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.770927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.771071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.771228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.771308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.771524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.771646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.771798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.771890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.772885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.773923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.774946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.775946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.776994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.777936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.778977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.779980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.780932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.781894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.782884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.783985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.784947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.785980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.786964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.787974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.788910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.789867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.790991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.791966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.792977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.793132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.793244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.793375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.793511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.793621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.793767 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.793867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.794837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.795851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.796985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.797965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798201 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.798919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.799907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.800848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.801926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.802161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.802251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.802379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.802517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.802606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.802779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.802857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.803892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.804051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.804142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.804300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.804376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.804547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.804623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.804779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.805904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806139 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.806977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.807946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.808982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.809922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.810014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:25:04.810100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.810333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.810573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.810815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.811055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.811295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.811547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.811810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.812071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.812323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.812564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.812811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.813057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.813309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.813548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.813789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.814026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.814275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.814529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.814764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.815010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.815311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.815594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.815846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.816098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.816338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.816581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.816819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.817058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.817329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.817788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.818090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.818334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.818583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.818822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.819074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.819315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.819564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.819825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.820069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.820306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:25:04.820477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:25:04.839332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.839569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.839822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.845591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.845829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.846059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.848288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.854610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.876652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.876899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.881106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.881349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.930360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.932107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.978294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.978549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.979489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:04.979755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.139333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.139642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.139786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.139868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.139957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.140034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.140097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.140158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.140220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.140298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.140379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.140453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.163248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.163504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.163675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.163772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.163854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.163919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.164762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.175535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.175939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.188621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.188831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.188929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.189115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.189207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.189333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.189456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.189580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.189712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.189838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.190000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.190123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.190258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81535) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.190396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81534) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:25:05.206560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.206750 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:25:05.207118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.207241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.207312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:25:05.207399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:25:05.207558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.207807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.208001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.208075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:25:05.208379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.208488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.208650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.208798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.209454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.209730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.218096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.218380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.218649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.218939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.219067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.219257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.219530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.219847 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.226037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.226764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.228949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.229232 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.229521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.229644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.229790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.229922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.230121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.230209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.230336 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.230494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.230587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.230758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.230885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.231009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.231218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.231410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.231601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.231738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.231869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.231998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.232230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.232506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.254379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.255570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.255914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.256201 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.257057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.257353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.260824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.261109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.261396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.262005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.262295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.262582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.267692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.267984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.268916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.269208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.272213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.272506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.272795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.273078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.273347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.273544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.273640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.273769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.273934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.274059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.274212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.274339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.274462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.274715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.274990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.275263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.291304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.291572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.292485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.292776 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.295405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.296605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.298629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.298928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.299815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.300152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.303229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.304833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.306357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.307983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.309708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.309947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.310239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.310524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.310809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.311099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.311480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.311810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.312105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.312393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.312647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.312952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.326925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.327215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.327484 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.327779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.328759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.329059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.329333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.329603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.334768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.336322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.336604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.336958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.338486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.338776 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.339199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.339489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.339809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.340092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.340395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.341415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.341714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.342008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.342293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.342586 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.351760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.352045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.352327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.352610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.352899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.353174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.353455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.353936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.354242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.354515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.354803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.355092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.355373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.355692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.368819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.370959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.371854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.374003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.374721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.376624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.377256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.378103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.378387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.378679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.378801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.380232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.380521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.380823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.385237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.386685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.387230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.388723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.389557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.389851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.390139 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.390425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.391768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.392063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.392354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.392636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.398428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.398725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.399008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.400913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.401211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.401499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.407178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81535) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.407465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.407778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.408058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.408336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81534) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:25:05.408478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.409436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.409563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.409731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.409856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.410015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.410137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.410297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.410420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.410583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.410717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.410903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.411177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.411304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.411454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.411609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.411786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81535) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.411935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.412096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.412381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.412660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.412942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.413208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81534) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:25:05.445705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa1c4a99c0 pid: 81535 (default app) Aug 24 16:25:05.447387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa1c4a99c0 pid: 81534 (default app) Aug 24 16:25:05.449147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838441a-a8fb-4a85-97bc-63e1b4daf41b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:05.449436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838441a-a8fb-4a85-97bc-63e1b4daf41b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:05.449711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838441a-a8fb-4a85-97bc-63e1b4daf41b None None] PATH_INFO: `/v3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:05.453952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 791 bytes} [Wed Aug 24 16:25:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:12.230803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45d5a-9d11-4f14-993a-6ef1cf79855f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:12.231649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45d5a-9d11-4f14-993a-6ef1cf79855f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:12.231810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45d5a-9d11-4f14-993a-6ef1cf79855f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:12.238953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1/2] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:12.247109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:12.247534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:12.247681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:12.326185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: INFO dbcounter [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] Registered counter for database keystone Aug 24 16:25:12.347717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG oslo_db.sqlalchemy.engines [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:25:12.358817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writer thread running {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:25:12.557875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG passlib.handlers.bcrypt [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81535) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 16:25:12.558314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG passlib.handlers.bcrypt [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81535) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 16:25:12.613700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:12.615393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:12.789942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 2/3] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 16:25:13.240331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45d5a-9d11-4f14-993a-6ef1cf79855f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:13.319077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: INFO dbcounter [None req-56b45d5a-9d11-4f14-993a-6ef1cf79855f None None] Registered counter for database keystone Aug 24 16:25:13.344737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG oslo_db.sqlalchemy.engines [None req-56b45d5a-9d11-4f14-993a-6ef1cf79855f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:25:13.352508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writer thread running {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:25:13.471895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45d5a-9d11-4f14-993a-6ef1cf79855f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:13.478052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1cf8a-c329-4d32-891d-b5076760aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:13.478680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1cf8a-c329-4d32-891d-b5076760aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:13.478960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1cf8a-c329-4d32-891d-b5076760aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:13.479232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1cf8a-c329-4d32-891d-b5076760aed3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:13.488260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1cf8a-c329-4d32-891d-b5076760aed3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:13.540765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING keystone.common.rbac_enforcer.enforcer [None req-03a1cf8a-c329-4d32-891d-b5076760aed3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 16:25:13.541041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1cf8a-c329-4d32-891d-b5076760aed3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:13.551507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 2/4] 10.222.0.88 () {58 vars in 1324 bytes} [Wed Aug 24 16:25:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:25:13.561583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:13.576847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a1394-4866-4ea4-92d9-20a1ef2c53ad None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:13.582532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f7492-82d9-4f30-b408-e260ade80f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:13.583744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7492-82d9-4f30-b408-e260ade80f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:13.584024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7492-82d9-4f30-b408-e260ade80f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:13.584297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7492-82d9-4f30-b408-e260ade80f7c admin admin] PATH_INFO: `/v3/projects/11fe830f962e44849f43a8ae423c5eae` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:13.585982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f7492-82d9-4f30-b408-e260ade80f7c admin admin] RBAC: Authorizing `identity:get_project(project_id=11fe830f962e44849f43a8ae423c5eae)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:13.639013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f6f7492-82d9-4f30-b408-e260ade80f7c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 16:25:13.639348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f7492-82d9-4f30-b408-e260ade80f7c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:13.644022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 3/5] 10.222.0.88 () {56 vars in 1207 bytes} [Wed Aug 24 16:25:13 2022] GET /identity/v3/projects/11fe830f962e44849f43a8ae423c5eae => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:15.539224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288127a3-51cb-405b-a7b4-0284e32b9c7c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:15.540073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288127a3-51cb-405b-a7b4-0284e32b9c7c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:15.540183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288127a3-51cb-405b-a7b4-0284e32b9c7c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:15.547041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 3/6] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:15.556716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1055-d709-409c-953f-db062687443f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:15.557395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1055-d709-409c-953f-db062687443f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:15.557576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1055-d709-409c-953f-db062687443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:15.584315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3adf1055-d709-409c-953f-db062687443f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:15.585792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3adf1055-d709-409c-953f-db062687443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:15.595537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 4/7] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 16:25:15.861675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288127a3-51cb-405b-a7b4-0284e32b9c7c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:15.879543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288127a3-51cb-405b-a7b4-0284e32b9c7c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:15.885373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91974366-0e64-4825-9893-bc962007738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:15.885989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91974366-0e64-4825-9893-bc962007738a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:15.886275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91974366-0e64-4825-9893-bc962007738a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:15.886555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91974366-0e64-4825-9893-bc962007738a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:15.895106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91974366-0e64-4825-9893-bc962007738a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:15.897185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91974366-0e64-4825-9893-bc962007738a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:15.906225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 4/8] 10.222.0.88 () {58 vars in 1324 bytes} [Wed Aug 24 16:25:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:25:15.915383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1055-d709-409c-953f-db062687443f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:15.931191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1055-d709-409c-953f-db062687443f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:15.939790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c373eb-da56-4805-932d-fc2633bc4753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:15.940793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c373eb-da56-4805-932d-fc2633bc4753 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:15.941256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c373eb-da56-4805-932d-fc2633bc4753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:15.941710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c373eb-da56-4805-932d-fc2633bc4753 admin admin] PATH_INFO: `/v3/users/2d40cc5420f2410681feb8bd4176552c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:15.944348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c373eb-da56-4805-932d-fc2633bc4753 admin admin] RBAC: Authorizing `identity:get_user(user_id=2d40cc5420f2410681feb8bd4176552c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:15.947317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c373eb-da56-4805-932d-fc2633bc4753 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:15.949878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 5/9] 10.222.0.88 () {56 vars in 1198 bytes} [Wed Aug 24 16:25:15 2022] GET /identity/v3/users/2d40cc5420f2410681feb8bd4176552c => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:17.906853 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b731-d521-4ed6-a1e3-a3eaf21bd4ce None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:17.907449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b731-d521-4ed6-a1e3-a3eaf21bd4ce None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:17.907449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b731-d521-4ed6-a1e3-a3eaf21bd4ce None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:17.908776 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 5/10] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:17.914331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055f46-a217-4928-8095-6dcfb5fba06e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:17.914762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055f46-a217-4928-8095-6dcfb5fba06e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:17.914973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055f46-a217-4928-8095-6dcfb5fba06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:17.933892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-03055f46-a217-4928-8095-6dcfb5fba06e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:17.935087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-03055f46-a217-4928-8095-6dcfb5fba06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:17.957998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db587150-8bf6-4055-9f78-5948599f0e59 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:17.958454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db587150-8bf6-4055-9f78-5948599f0e59 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:17.959010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db587150-8bf6-4055-9f78-5948599f0e59 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:17.960401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 6/11] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:17.965760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:17.966056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:17.966332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:18.010406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG passlib.handlers.bcrypt [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81534) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 16:25:18.010841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG passlib.handlers.bcrypt [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81534) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 16:25:18.027167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 6/12] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:18.056386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:18.057977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:18.157896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 7/13] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:18.295509 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055f46-a217-4928-8095-6dcfb5fba06e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.322990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:18.405484 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055f46-a217-4928-8095-6dcfb5fba06e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:18.420210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.440921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:18.441609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:18.441887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:18.442160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:18.455253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:18.464026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:18.464959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:18.465826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 7/14] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:18.471207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.529760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d796b7-c487-4281-a3e8-3a18be4ef0e0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:18.532170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:18.560233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:18.569989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:18.570877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:18.571155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:18.571423 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:18.578827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf200d-d022-4573-baa6-575f8d384d9f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:18.611982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:18.612603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:18.612883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:18.613156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:18.613827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:18.614135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:18.615669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:18.627821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 8/15] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:18.633709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.642193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:18.643768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:18.735673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921e1f-b2d4-4cdc-8038-338398c8a918 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:18.743855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 8/16] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:25:18.749687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.752850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:18.771024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:18.771697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:18.771962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:18.772226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] PATH_INFO: `/v3/users/2d40cc5420f2410681feb8bd4176552c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:18.773366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] RBAC: Authorizing `identity:get_user(user_id=2d40cc5420f2410681feb8bd4176552c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:18.774821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:18.776431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 9/17] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/users/2d40cc5420f2410681feb8bd4176552c => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:18.781844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.796011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:18.850364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40ba8c-77a6-431d-9e79-de7939545273 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:18.880417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfe0f6-d8eb-4216-b168-6a05480f320b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:18.885141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:18.886016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:18.886298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:18.886572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:18.906063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:18.907603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:18.916390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:18.917037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:18.917313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:18.917578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:18.918716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:18.920222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:18.921783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 10/18] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:25:18.926575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:18.927604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:25:18.928493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:25:18.928493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:25:18.928493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:18.928659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.928737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 9/19] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:25:18.933463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:18.990330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:19.007815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:19.028256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd77f39-3fda-41c1-bca7-23e9a7e9af37 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:19.035202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912d85e-7998-43d8-8673-c12c9aac61fa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:19.062083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157be88b-90fd-4f2a-ae93-8a8eed50710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:19.062693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be88b-90fd-4f2a-ae93-8a8eed50710d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:19.062968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be88b-90fd-4f2a-ae93-8a8eed50710d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:19.063242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be88b-90fd-4f2a-ae93-8a8eed50710d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:19.063994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be88b-90fd-4f2a-ae93-8a8eed50710d None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.domain.id=default, user.id=2d40cc5420f2410681feb8bd4176552c) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:19.064295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be88b-90fd-4f2a-ae93-8a8eed50710d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:19.065914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be88b-90fd-4f2a-ae93-8a8eed50710d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:19.068662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ad9e-2c43-400d-9ccb-9d12383d8794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:19.069267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ad9e-2c43-400d-9ccb-9d12383d8794 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:19.069544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ad9e-2c43-400d-9ccb-9d12383d8794 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:19.069813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ad9e-2c43-400d-9ccb-9d12383d8794 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:19.070474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ad9e-2c43-400d-9ccb-9d12383d8794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:19.070768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ad9e-2c43-400d-9ccb-9d12383d8794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:19.072167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ad9e-2c43-400d-9ccb-9d12383d8794 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:19.072902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 11/20] 10.222.0.88 () {56 vars in 1322 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/role_assignments?user.id=2d40cc5420f2410681feb8bd4176552c&scope.domain.id=default&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:19.091483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 10/21] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:21.226052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb93aff-326a-4439-be24-573e935f359c None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:21.226623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb93aff-326a-4439-be24-573e935f359c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:21.226623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb93aff-326a-4439-be24-573e935f359c None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:21.227958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 12/22] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:21.233656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95341d4f-3bce-4d17-91fb-cf50e71d8278 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:21.234093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95341d4f-3bce-4d17-91fb-cf50e71d8278 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:21.234270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95341d4f-3bce-4d17-91fb-cf50e71d8278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:21.260720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-95341d4f-3bce-4d17-91fb-cf50e71d8278 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:21.261918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-95341d4f-3bce-4d17-91fb-cf50e71d8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:21.374147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 11/23] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:21.464892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c1e4-be01-4cc1-881e-812eca90a8de None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:21.465227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c1e4-be01-4cc1-881e-812eca90a8de None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:21.465450 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575c1e4-be01-4cc1-881e-812eca90a8de None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:21.466946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 13/24] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:21.479378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a083f-b214-433a-b592-86968bdb9f37 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:21.479946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a083f-b214-433a-b592-86968bdb9f37 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:21.480407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a083f-b214-433a-b592-86968bdb9f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:21.509040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-030a083f-b214-433a-b592-86968bdb9f37 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:21.510560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-030a083f-b214-433a-b592-86968bdb9f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:21.573552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:21.604946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 12/25] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:21.680950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03809a43-763f-493c-af01-a1a83cc5e932 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:21.681483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03809a43-763f-493c-af01-a1a83cc5e932 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:21.681917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03809a43-763f-493c-af01-a1a83cc5e932 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:21.683401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 14/26] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:21.688871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1276e-1d61-4eac-a2ea-d40ce0a97ba5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:21.689160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1276e-1d61-4eac-a2ea-d40ce0a97ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:21.689433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1276e-1d61-4eac-a2ea-d40ce0a97ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:21.716679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c6a1276e-1d61-4eac-a2ea-d40ce0a97ba5 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:21.717891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c6a1276e-1d61-4eac-a2ea-d40ce0a97ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:21.804118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 13/27] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:21.868550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03809a43-763f-493c-af01-a1a83cc5e932 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:21.997371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03809a43-763f-493c-af01-a1a83cc5e932 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:22.043463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddebed-7cbd-481e-a008-25f247e57da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:22.044560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddebed-7cbd-481e-a008-25f247e57da9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.045043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddebed-7cbd-481e-a008-25f247e57da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.045526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddebed-7cbd-481e-a008-25f247e57da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.060132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddebed-7cbd-481e-a008-25f247e57da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4bddebed-7cbd-481e-a008-25f247e57da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:22.065646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:22.066487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:22.067254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:22.070124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 15/28] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:22.076295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1276e-1d61-4eac-a2ea-d40ce0a97ba5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:22.124894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32cc97-583c-49b2-a1aa-475d7b252db4 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.125496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32cc97-583c-49b2-a1aa-475d7b252db4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.125968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32cc97-583c-49b2-a1aa-475d7b252db4 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.132018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 16/29] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:22.141379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66839032-f1d4-4f14-b39a-edc870a034ba None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.141908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66839032-f1d4-4f14-b39a-edc870a034ba None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.142374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66839032-f1d4-4f14-b39a-edc870a034ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.162093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:22.172617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-66839032-f1d4-4f14-b39a-edc870a034ba None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:22.174227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-66839032-f1d4-4f14-b39a-edc870a034ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:22.244194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1276e-1d61-4eac-a2ea-d40ce0a97ba5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:22.257950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:22.285333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:22.286412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.286703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.286986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.288005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:22.288313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:22.290461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:22.297010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 17/30] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:22.297859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66839032-f1d4-4f14-b39a-edc870a034ba None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:22.314573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 14/31] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:22.316137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:22.436154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66839032-f1d4-4f14-b39a-edc870a034ba None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:22.456485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82854a3b-c9e1-4ccd-b417-490c9f2cd7af None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:22.481071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceffac6-2906-4e77-b647-a0c485bb1fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:22.482256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceffac6-2906-4e77-b647-a0c485bb1fec None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.482911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceffac6-2906-4e77-b647-a0c485bb1fec None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.483327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceffac6-2906-4e77-b647-a0c485bb1fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.485860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:22.495622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:22.496364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceffac6-2906-4e77-b647-a0c485bb1fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:22.496732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.497193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.497647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.497992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceffac6-2906-4e77-b647-a0c485bb1fec None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:22.498973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:22.500748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8ceffac6-2906-4e77-b647-a0c485bb1fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:25:22.515611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:22.516556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:25:22.517369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:25:22.517369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:25:22.517369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:22.519185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 18/32] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:22.520769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db87f-b520-4aec-b173-2d0af3147ebd None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.521442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db87f-b520-4aec-b173-2d0af3147ebd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.521951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db87f-b520-4aec-b173-2d0af3147ebd None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.523447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 19/33] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:22.524396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db87f-b520-4aec-b173-2d0af3147ebd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:22.642811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db87f-b520-4aec-b173-2d0af3147ebd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:22.648605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 15/34] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 16:25:22 2022] POST /identity/v3/roles => generated 219 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:22.648605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:22.684330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:22.693467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0293392-26cb-485a-b258-d9fe6e7da84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:22.693699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293392-26cb-485a-b258-d9fe6e7da84a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.694040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293392-26cb-485a-b258-d9fe6e7da84a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.694365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0293392-26cb-485a-b258-d9fe6e7da84a None admin] PATH_INFO: `/v3/users/2d40cc5420f2410681feb8bd4176552c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.695666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0293392-26cb-485a-b258-d9fe6e7da84a None admin] RBAC: Authorizing `identity:get_user(user_id=2d40cc5420f2410681feb8bd4176552c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:22.697270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0293392-26cb-485a-b258-d9fe6e7da84a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:22.699190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 20/35] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:22 2022] GET /identity/v3/users/2d40cc5420f2410681feb8bd4176552c => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:22.700335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039618-86dd-4c1e-aa8f-dfcf3061a4af None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.700620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039618-86dd-4c1e-aa8f-dfcf3061a4af None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.700892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039618-86dd-4c1e-aa8f-dfcf3061a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.721442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-15039618-86dd-4c1e-aa8f-dfcf3061a4af None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:22.722715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-15039618-86dd-4c1e-aa8f-dfcf3061a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:22.772435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796fdd9-d1ee-4b41-8cfc-d850dffa3ecc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:22.782936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:22.801364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 21/36] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:22.807832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15039618-86dd-4c1e-aa8f-dfcf3061a4af None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:22.826719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:22.827513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.827915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.828196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.828924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:22.829230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:22.830772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:22.853572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 16/37] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:22.855333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:22.927051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15039618-86dd-4c1e-aa8f-dfcf3061a4af None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:22.973077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:22.974677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:22.975538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:22.975944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:22.976222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:22.977028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:22.978880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:22.992057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8768d6d-98dc-4e3e-832a-8524ea5152d7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:23.038810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:23.040003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:23.040501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:23.040984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:23.042837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:23.044806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:23.046884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 17/38] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:23.047915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:23.116990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 22/39] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 16:25:22 2022] POST /identity/v3/roles => generated 225 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:23.118082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:23.172040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:23.189275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771daca4-e948-4c0d-9539-d85d3ae84cd5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:23.236628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:23.237256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:23.237539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:23.237836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:23.238532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57435a-8c4e-458a-bd0a-1e1e6bace793 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:23.238629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:23.240185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:23.273623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 18/40] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:25:23 2022] POST /identity/v3/projects => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:23.279512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2ef28-022c-4d53-aa92-48347d6e0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:23.280306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2ef28-022c-4d53-aa92-48347d6e0abb None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:23.280687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2ef28-022c-4d53-aa92-48347d6e0abb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:23.280972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2ef28-022c-4d53-aa92-48347d6e0abb None admin] PATH_INFO: `/v3/domains/default/users/2d40cc5420f2410681feb8bd4176552c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:23.283381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2ef28-022c-4d53-aa92-48347d6e0abb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2d40cc5420f2410681feb8bd4176552c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:23.284679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:23.285095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2ef28-022c-4d53-aa92-48347d6e0abb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:23.297041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:23.320949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 23/41] 10.222.0.88 () {58 vars in 1361 bytes} [Wed Aug 24 16:25:23 2022] PUT /identity/v3/domains/default/users/2d40cc5420f2410681feb8bd4176552c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:25:23.323690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779340f4-bcd7-4762-bcbb-ccca5c232ef6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:23.324697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779340f4-bcd7-4762-bcbb-ccca5c232ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:23.325174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779340f4-bcd7-4762-bcbb-ccca5c232ef6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:23.327180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 24/42] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:23.334921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6babf59-1b62-4e17-bb69-5577711932f4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:23.335251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6babf59-1b62-4e17-bb69-5577711932f4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:23.335477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6babf59-1b62-4e17-bb69-5577711932f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:23.362089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f6babf59-1b62-4e17-bb69-5577711932f4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:23.365358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f6babf59-1b62-4e17-bb69-5577711932f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:23.440593 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2acd3f-2965-489d-91a7-82178aae7e70 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:23.455183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 25/43] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:23.493794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:23.494805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:23.495275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:23.495755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:23.496617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:23.498075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:23.517384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 19/44] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 16:25:23 2022] POST /identity/v3/roles => generated 223 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:23.732859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6babf59-1b62-4e17-bb69-5577711932f4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:23.769088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:23.838568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6babf59-1b62-4e17-bb69-5577711932f4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:23.873353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc379cb-b5f9-4063-83b7-eabf5ce9e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:23.873982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc379cb-b5f9-4063-83b7-eabf5ce9e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:23.874257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc379cb-b5f9-4063-83b7-eabf5ce9e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:23.874527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc379cb-b5f9-4063-83b7-eabf5ce9e3d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:23.875665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc379cb-b5f9-4063-83b7-eabf5ce9e3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:23.877468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc379cb-b5f9-4063-83b7-eabf5ce9e3d9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:23.879211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 26/45] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:23.884882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:23.956297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:23.993073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf1141-38e3-4d23-9b64-04d77b2ca8c0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:24.027168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4008ba-5189-4155-8dac-c61380dec982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:24.027820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4008ba-5189-4155-8dac-c61380dec982 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:24.028097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4008ba-5189-4155-8dac-c61380dec982 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:24.028350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4008ba-5189-4155-8dac-c61380dec982 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:24.028989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4008ba-5189-4155-8dac-c61380dec982 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:24.030458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4008ba-5189-4155-8dac-c61380dec982 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:24.059600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 20/46] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:25:23 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:25.278893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74ed46-1a42-427f-a92a-2a857a94e18f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:25.279433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74ed46-1a42-427f-a92a-2a857a94e18f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:25.279433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74ed46-1a42-427f-a92a-2a857a94e18f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:25.280833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 27/47] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:25.286505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8416-9f82-47f3-a0fd-4af65cc18eab None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:25.286931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8416-9f82-47f3-a0fd-4af65cc18eab None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:25.286931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee8416-9f82-47f3-a0fd-4af65cc18eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:25.306296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-38ee8416-9f82-47f3-a0fd-4af65cc18eab None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:25.307864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-38ee8416-9f82-47f3-a0fd-4af65cc18eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:25.380913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 21/48] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:25.647494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74ed46-1a42-427f-a92a-2a857a94e18f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:25.756614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74ed46-1a42-427f-a92a-2a857a94e18f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:25.758149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:25.904165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521cd3-f4c9-4807-963f-48141e8539e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:25.904708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521cd3-f4c9-4807-963f-48141e8539e7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:25.904992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521cd3-f4c9-4807-963f-48141e8539e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:25.905262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521cd3-f4c9-4807-963f-48141e8539e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:25.915808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521cd3-f4c9-4807-963f-48141e8539e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9d521cd3-f4c9-4807-963f-48141e8539e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:25.920756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:25.921541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:25.922618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 28/49] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:25.928024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8416-9f82-47f3-a0fd-4af65cc18eab None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:25.951915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74019226-c319-4245-bf7b-03028cd2acd9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:25.952192 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74019226-c319-4245-bf7b-03028cd2acd9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:25.952464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74019226-c319-4245-bf7b-03028cd2acd9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:25.953843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 29/50] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:25.959251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffed4a-62cb-4d3f-91a8-921bd675c2e8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:25.959551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffed4a-62cb-4d3f-91a8-921bd675c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:25.959855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffed4a-62cb-4d3f-91a8-921bd675c2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:25.977387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-91ffed4a-62cb-4d3f-91a8-921bd675c2e8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:25.978613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-91ffed4a-62cb-4d3f-91a8-921bd675c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:25.982049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:26.037517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee8416-9f82-47f3-a0fd-4af65cc18eab None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:26.048546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 30/51] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:26.180827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:26.181342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:26.181615 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:26.181884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:26.182550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:26.182849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:26.184246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:26.192450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 22/52] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:26.198548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffed4a-62cb-4d3f-91a8-921bd675c2e8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:26.291988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:26.302934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffed4a-62cb-4d3f-91a8-921bd675c2e8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:26.317708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:26.338494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:26.339148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:26.339799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:26.340088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] PATH_INFO: `/v3/users/2d40cc5420f2410681feb8bd4176552c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:26.341351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] RBAC: Authorizing `identity:get_user(user_id=2d40cc5420f2410681feb8bd4176552c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:26.342833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:26.344690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 31/53] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:26 2022] GET /identity/v3/users/2d40cc5420f2410681feb8bd4176552c => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:26.350299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:26.424526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a6580-5c95-4ed5-bb34-1802369a7e24 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:26.437741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:26.453930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf658c-cd73-4c34-9379-33a58c86cd79 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:26.459636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:26.460277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:26.460555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:26.460823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:26.462031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:26.463484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:26.465110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 23/54] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:26.471044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:26.491570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:26.492267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:26.492552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:26.492822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:26.493976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:26.495454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:26.497069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 32/55] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:26.503343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:26.531633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:26.576927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dff72-5f03-4531-b0a9-284c078b1f01 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:26.605845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5722f-c36d-4d4b-8e81-d84ac60c0502 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:26.610517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411ef41-ec11-49d7-bfdd-fb45f632acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:26.611145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ef41-ec11-49d7-bfdd-fb45f632acf4 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:26.611430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ef41-ec11-49d7-bfdd-fb45f632acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:26.611753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411ef41-ec11-49d7-bfdd-fb45f632acf4 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:26.612407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ef41-ec11-49d7-bfdd-fb45f632acf4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:26.613869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411ef41-ec11-49d7-bfdd-fb45f632acf4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:26.641263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd908-d543-4276-bbdf-8678dc95c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:26.641914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd908-d543-4276-bbdf-8678dc95c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:26.642193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd908-d543-4276-bbdf-8678dc95c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:26.642464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd908-d543-4276-bbdf-8678dc95c0f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:26.642736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 24/56] 10.222.0.88 () {60 vars in 1140 bytes} [Wed Aug 24 16:25:26 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:26.643193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd908-d543-4276-bbdf-8678dc95c0f2 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.domain.id=default, user.id=2d40cc5420f2410681feb8bd4176552c) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:26.643470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd908-d543-4276-bbdf-8678dc95c0f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:26.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd908-d543-4276-bbdf-8678dc95c0f2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:26.651613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 33/57] 10.222.0.88 () {56 vars in 1322 bytes} [Wed Aug 24 16:25:26 2022] GET /identity/v3/role_assignments?user.id=2d40cc5420f2410681feb8bd4176552c&scope.domain.id=default&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:28.563694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc00da-e04b-4302-988a-4652adf3ae67 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:28.564514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc00da-e04b-4302-988a-4652adf3ae67 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:28.564514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc00da-e04b-4302-988a-4652adf3ae67 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:28.566616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 25/58] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:28.575679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a021f-dd2e-4e36-98d7-7b8d55c83892 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:28.576284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a021f-dd2e-4e36-98d7-7b8d55c83892 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:28.576614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a021f-dd2e-4e36-98d7-7b8d55c83892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:28.598663 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a71a021f-dd2e-4e36-98d7-7b8d55c83892 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:28.600173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a71a021f-dd2e-4e36-98d7-7b8d55c83892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:28.674355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 34/59] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:28.944132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc00da-e04b-4302-988a-4652adf3ae67 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:28.980292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:29.059779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc00da-e04b-4302-988a-4652adf3ae67 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:29.095278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cbd83-526e-49e3-a2ab-e6cf59d2ff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:29.095939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbd83-526e-49e3-a2ab-e6cf59d2ff84 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:29.096217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbd83-526e-49e3-a2ab-e6cf59d2ff84 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:29.096493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbd83-526e-49e3-a2ab-e6cf59d2ff84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:29.097760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cbd83-526e-49e3-a2ab-e6cf59d2ff84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:29.099372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cbd83-526e-49e3-a2ab-e6cf59d2ff84 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:29.101014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 26/60] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:29.106919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a021f-dd2e-4e36-98d7-7b8d55c83892 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:29.134870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:29.213948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a021f-dd2e-4e36-98d7-7b8d55c83892 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:29.250634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158d993-5412-4946-bb99-bd413c7fdb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:29.251231 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d993-5412-4946-bb99-bd413c7fdb94 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:29.251507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d993-5412-4946-bb99-bd413c7fdb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:29.252151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158d993-5412-4946-bb99-bd413c7fdb94 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:29.252786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158d993-5412-4946-bb99-bd413c7fdb94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:29.254319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158d993-5412-4946-bb99-bd413c7fdb94 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:29.284324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 35/61] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:25:29 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:32.394576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381017fc-5f14-4629-9b54-f70c84030b8f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.395468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381017fc-5f14-4629-9b54-f70c84030b8f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.395997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381017fc-5f14-4629-9b54-f70c84030b8f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.397532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 27/62] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:32.416458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d5ee-f76a-46a3-8ea1-27ee3db7b8d7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.417417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d5ee-f76a-46a3-8ea1-27ee3db7b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.417880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85d5ee-f76a-46a3-8ea1-27ee3db7b8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.441883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ec85d5ee-f76a-46a3-8ea1-27ee3db7b8d7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:32.443930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ec85d5ee-f76a-46a3-8ea1-27ee3db7b8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:32.448778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ceff-fd02-4ca0-8ba9-865309a21394 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.449366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ceff-fd02-4ca0-8ba9-865309a21394 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.449837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ceff-fd02-4ca0-8ba9-865309a21394 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.451446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 28/63] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:32.456864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7044ef-db79-4ec1-b7eb-32411a69a239 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.457368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7044ef-db79-4ec1-b7eb-32411a69a239 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.457852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7044ef-db79-4ec1-b7eb-32411a69a239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.496618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-db7044ef-db79-4ec1-b7eb-32411a69a239 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:32.498182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-db7044ef-db79-4ec1-b7eb-32411a69a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:32.525999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 36/64] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:32.605198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 29/65] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:32.705618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc543-7b23-4288-b173-12235b952bf5 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.706277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc543-7b23-4288-b173-12235b952bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.706746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc543-7b23-4288-b173-12235b952bf5 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.708383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 37/66] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:32.714331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579efc8-d245-4e47-92ee-1010af0029d7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.714882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579efc8-d245-4e47-92ee-1010af0029d7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.715375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579efc8-d245-4e47-92ee-1010af0029d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.733883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d10d-a9ab-4ece-ba72-7bc3203dc956 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.734477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d10d-a9ab-4ece-ba72-7bc3203dc956 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.734970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d10d-a9ab-4ece-ba72-7bc3203dc956 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.736608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 38/67] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:32.741557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a676-70b3-4bea-af94-cd286a2ce57f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:32.742079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a676-70b3-4bea-af94-cd286a2ce57f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:32.742545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a676-70b3-4bea-af94-cd286a2ce57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:32.757829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3579efc8-d245-4e47-92ee-1010af0029d7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:32.760487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3579efc8-d245-4e47-92ee-1010af0029d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:32.776068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bfb4a676-70b3-4bea-af94-cd286a2ce57f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:32.777521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bfb4a676-70b3-4bea-af94-cd286a2ce57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:32.781897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:32.807079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:32.867110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 39/68] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:32.868768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a676-70b3-4bea-af94-cd286a2ce57f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:32.871672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 30/69] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:32.977327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a676-70b3-4bea-af94-cd286a2ce57f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:32.978550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579efc8-d245-4e47-92ee-1010af0029d7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.019509 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1ab6a-8e64-401c-ba8c-e312fb833378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.020345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ab6a-8e64-401c-ba8c-e312fb833378 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.020623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ab6a-8e64-401c-ba8c-e312fb833378 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.020969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ab6a-8e64-401c-ba8c-e312fb833378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.031351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.035904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1ab6a-8e64-401c-ba8c-e312fb833378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e4a1ab6a-8e64-401c-ba8c-e312fb833378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:33.046490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:33.047561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:33.048381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:33.049413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 40/70] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:33.055404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fbd78-caa0-45e9-a873-75224886c87e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.055404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fbd78-caa0-45e9-a873-75224886c87e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.055404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fbd78-caa0-45e9-a873-75224886c87e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.055404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 41/71] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:33.060142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fbd78-caa0-45e9-a873-75224886c87e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.104816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579efc8-d245-4e47-92ee-1010af0029d7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.142785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00b00e-7d29-41fb-8963-99b7e2a10753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.143755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00b00e-7d29-41fb-8963-99b7e2a10753 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.144208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00b00e-7d29-41fb-8963-99b7e2a10753 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.144644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00b00e-7d29-41fb-8963-99b7e2a10753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.156362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00b00e-7d29-41fb-8963-99b7e2a10753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5c00b00e-7d29-41fb-8963-99b7e2a10753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:33.163193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:33.164144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:33.164987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:33.167167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 31/72] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:33.168610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d4aa8-400b-469d-bdc9-91468981369e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.168894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d4aa8-400b-469d-bdc9-91468981369e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.169170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d4aa8-400b-469d-bdc9-91468981369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.187626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b09d4aa8-400b-469d-bdc9-91468981369e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:33.188831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b09d4aa8-400b-469d-bdc9-91468981369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:33.192521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fbd78-caa0-45e9-a873-75224886c87e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.202919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.226208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.226830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.227111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.227385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.228094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:33.228400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:33.229803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:33.237787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 42/73] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:33.240653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.256837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 32/74] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:33.257526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d4aa8-400b-469d-bdc9-91468981369e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.314036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.360125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe599114-9916-444d-b40e-bd748b190b88 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.368581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d4aa8-400b-469d-bdc9-91468981369e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.397428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.398087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.398376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.398652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.408717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.409193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:33.409980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.410425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.410863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.411946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:33.412433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:33.413979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:33.414078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:33.414863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:33.415675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 43/75] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:33.416372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.426510 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 33/76] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:33.431007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.448620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.522481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2997c00-c937-44ab-9a81-ef98faf31b3e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.536109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a227212-e1dc-4095-8317-5b6505187ca5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.542103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.557070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.557722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.558006 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.558308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.569108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:33.569982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.570628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.570911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.571247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:33.573788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:33.574624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 44/77] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:33.580021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.591510 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:33.593026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:33.594706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 34/78] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:33.595456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.665649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.682713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39bc55-5497-4b8b-9128-af7ba50cb9ef None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.698386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7b372-b76e-40f7-aa7d-7b035e5c7338 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.716090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.716708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.716990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.717268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.717939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:33.718245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:33.719681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:33.728410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 45/79] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:33.729193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.733500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.734182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.734445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.734720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] PATH_INFO: `/v3/users/2d40cc5420f2410681feb8bd4176552c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.735904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] RBAC: Authorizing `identity:get_user(user_id=2d40cc5420f2410681feb8bd4176552c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:33.737375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:33.738956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 35/80] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/users/2d40cc5420f2410681feb8bd4176552c => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:33.744479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.772961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.829447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf7f7-7854-4a17-b552-7dfff62412c4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.845007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a45fa9-9a35-46c9-96d6-4045f3f997df None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.862615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.863251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.863535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.863838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.865008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:33.866480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:33.868126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 46/81] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:33.873384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.879076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:33.879727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:33.880008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:33.880329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:33.881002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:33.881308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:33.882687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:33.887834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.895340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 36/82] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:33.896659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:33.972150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2eed34-86d6-46d4-aa6b-91678ac6889c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:33.982482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:33.998549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d4088-82bb-4d33-b460-20ac068accec None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.006658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.007270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.007549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.007875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.032463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.033094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.033378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.033654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.034793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.036327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.042608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 37/83] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:34.042608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.075374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.076927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.105531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:34.140750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d3294-8607-4056-8bfa-061708a25869 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.175049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.175700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.175986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.176263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.180518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 47/84] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:34.185343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.197459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:34.245462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.246938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.286466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e455194-d800-4568-91f8-80776440e7cc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.320397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:34.325128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.325268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.325548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.325821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.326471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.327957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.349681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 48/85] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:25:34 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:34.350509 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.358431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 38/86] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:34.359323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.426512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:34.469785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a691-8787-4ae0-8ddf-42599d04b855 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.482444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600bae9-d504-4559-ae13-440c94b64b35 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.511671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.512271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.512553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.512811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.513988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.515980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.517260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 49/87] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:34 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:34.517873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.527914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.528563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.528840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.529109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.579528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:34.628561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.630053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.644628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aae7e3-f1d9-47b6-b704-3d50a96c0ad0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.696638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.697298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.697579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.697857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.699119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.701139 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.706802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 50/88] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:34 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:34.706802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.707753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:34.772794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 39/89] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:34.774191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.848738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6cdcf-d9a9-48b2-8959-a93262d3f512 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.859500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:34.886169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.887220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.887749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.888215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.889721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:34.891369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:34.893262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 51/90] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:34 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:34.894401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:34.899999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc089eda-a33b-43ec-9506-16803a589626 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:34.938629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:34.939271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:34.939555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:34.940213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:34.969132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:35.008649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932d3f5-9180-4503-9a5d-462d9461dc78 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:35.015991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:35.017498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:35.055523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:35.056518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:35.057034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:35.057499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:35.058428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:35.058931 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:35.060638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:35.068707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 52/91] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:34 2022] GET /identity/v3/role_assignments?user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:35.070154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:35.110267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:35.195437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 40/92] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:35.196445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:35.287952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb720b-c5b8-4e39-95cb-59fa56031ca5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:35.321976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f1d27-183b-4eda-9126-378410155b25 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:35.356659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:35.357316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:35.357692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:35.357976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] PATH_INFO: `/v3/projects/9fb64fd78cd444f5a7f1075a123a9599` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:35.358236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:35.358985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:35.359344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:35.359718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:35.360274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] RBAC: Authorizing `identity:get_project(project_id=9fb64fd78cd444f5a7f1075a123a9599)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:35.360604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=2d40cc5420f2410681feb8bd4176552c) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:35.360984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:35.361825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:35.362667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:35.363499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 53/93] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:35 2022] GET /identity/v3/projects/9fb64fd78cd444f5a7f1075a123a9599 => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:35.364285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:35.373469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:35.381925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 41/94] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:35 2022] GET /identity/v3/role_assignments?user.id=2d40cc5420f2410681feb8bd4176552c&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:35.382924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:35.480001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:35.608314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc04d2-ccfe-4d51-b4a9-7203682762c6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:35.623923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7b75a-f7d8-4ad4-a36c-f4665bc4a961 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:35.650218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:35.650866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:35.651214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:35.651495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:35.652330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=9fb64fd78cd444f5a7f1075a123a9599, user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:35.652763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:35.654241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:35.660815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 42/95] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:35 2022] GET /identity/v3/role_assignments?user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4&scope.project.id=9fb64fd78cd444f5a7f1075a123a9599&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:35.696600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6d41c-323d-4c34-af22-cccae57105a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:35.697329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6d41c-323d-4c34-af22-cccae57105a5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:35.697615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6d41c-323d-4c34-af22-cccae57105a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:35.697890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6d41c-323d-4c34-af22-cccae57105a5 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:35.699310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6d41c-323d-4c34-af22-cccae57105a5 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:35.700861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6d41c-323d-4c34-af22-cccae57105a5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:35.702843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 54/96] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:35 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:35.709302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:35.857169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:35.863879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98dd1-696a-4cd4-9d24-de161f101497 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:35.914157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a231d-3270-4529-84f4-f087047d66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:35.914780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a231d-3270-4529-84f4-f087047d66de None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:35.915059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a231d-3270-4529-84f4-f087047d66de None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:35.915328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a231d-3270-4529-84f4-f087047d66de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:35.916111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a231d-3270-4529-84f4-f087047d66de None admin] RBAC: Adding query filter params (role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:35.916415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a231d-3270-4529-84f4-f087047d66de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:35.917873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a231d-3270-4529-84f4-f087047d66de None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:35.928017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 43/97] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:35 2022] GET /identity/v3/role_assignments?user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=66545c4116b74dad93fef433e2619ef8 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:36.623803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0d22-9998-45ff-beca-b8e30df47b65 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:36.624035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0d22-9998-45ff-beca-b8e30df47b65 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:36.624457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0d22-9998-45ff-beca-b8e30df47b65 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:36.625730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 55/98] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:36.631953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14592e8-e920-462d-b9f1-b7649c99a97b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:36.632435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14592e8-e920-462d-b9f1-b7649c99a97b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:36.632510 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14592e8-e920-462d-b9f1-b7649c99a97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:36.651277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a14592e8-e920-462d-b9f1-b7649c99a97b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:36.652518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a14592e8-e920-462d-b9f1-b7649c99a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:36.723273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 44/99] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:37.064086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e002-56c6-47f6-91c7-b0487dff64c1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:37.064584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e002-56c6-47f6-91c7-b0487dff64c1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:37.064657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33e002-56c6-47f6-91c7-b0487dff64c1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:37.066239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 56/100] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:37.079062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14592e8-e920-462d-b9f1-b7649c99a97b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:37.081537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e805d1-6840-4b7f-8345-eef0a4358709 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:37.081829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e805d1-6840-4b7f-8345-eef0a4358709 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:37.082105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e805d1-6840-4b7f-8345-eef0a4358709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:37.118018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-03e805d1-6840-4b7f-8345-eef0a4358709 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:37.119239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-03e805d1-6840-4b7f-8345-eef0a4358709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:37.254653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:37.265704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:37.266629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 57/101] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:37.276598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14592e8-e920-462d-b9f1-b7649c99a97b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:37.313189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:37.313813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:37.314157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:37.314436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:37.326625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:37.331479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:37.332363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:37.333126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 45/102] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:37.339234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e805d1-6840-4b7f-8345-eef0a4358709 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:37.470426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e805d1-6840-4b7f-8345-eef0a4358709 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:37.525176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f31a-8d34-4267-80ff-e5880276770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:37.526185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f31a-8d34-4267-80ff-e5880276770e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:37.526661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f31a-8d34-4267-80ff-e5880276770e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:37.527125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f31a-8d34-4267-80ff-e5880276770e None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:37.528030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f31a-8d34-4267-80ff-e5880276770e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:37.528600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f31a-8d34-4267-80ff-e5880276770e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:37.530215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f31a-8d34-4267-80ff-e5880276770e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:37.544069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 58/103] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:37.550288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:37.569648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd7f1a-a4bf-402a-b65c-4529e55ca1fa None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:37.570242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd7f1a-a4bf-402a-b65c-4529e55ca1fa None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:37.570715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd7f1a-a4bf-402a-b65c-4529e55ca1fa None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:37.572435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 59/104] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:37.577919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d025ca-9ab4-428e-9875-78da927f34d1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:37.578479 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d025ca-9ab4-428e-9875-78da927f34d1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:37.579006 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d025ca-9ab4-428e-9875-78da927f34d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:37.616620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-71d025ca-9ab4-428e-9875-78da927f34d1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:37.618211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-71d025ca-9ab4-428e-9875-78da927f34d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:37.740187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:37.743901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 60/105] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:37.745212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d025ca-9ab4-428e-9875-78da927f34d1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:37.761918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aff03-93e5-4428-98e1-f77d186e89ea None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:37.848384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:37.849024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:37.849652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:37.849754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] PATH_INFO: `/v3/users/ed3e53a309284b13838b795178694fe3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:37.880322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] RBAC: Authorizing `identity:get_user(user_id=ed3e53a309284b13838b795178694fe3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:37.882134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:37.884303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 46/106] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:37 2022] GET /identity/v3/users/ed3e53a309284b13838b795178694fe3 => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:37.892045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:37.913698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:37.947613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d025ca-9ab4-428e-9875-78da927f34d1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:38.032315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:38.032984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.033268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.033546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.040334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:38.041856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:38.043916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 61/107] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:38.060617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:38.077781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4aff1-0aa7-49f3-ac27-d21b92da6a6b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:38.149763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:38.150310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.150595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.150867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.203951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:38.260490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:38.262747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:38.274493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:38.280283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae978c-b262-4094-959c-f7a579dd3b92 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:38.349883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:38.350522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.350805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.351086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.351764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:38.353229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:38.404306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 62/108] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:25:38 2022] POST /identity/v3/projects => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:38.405444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:38.445176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 47/109] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:38.456179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:38.535990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f85e7-ef8f-411c-b5c1-4ec199fb8fa3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:38.553215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:38.583183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:38.584950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.585655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.586103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.601069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:38.608321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:38.609975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:38.611547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:38.614046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 63/110] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:38.619306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:38.664667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360acc-f4df-42b0-84f6-66e104664ba1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:38.682454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:38.716722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd684-b51a-424c-889b-1b8239dc8579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:38.717367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd684-b51a-424c-889b-1b8239dc8579 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.717647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd684-b51a-424c-889b-1b8239dc8579 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.717916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd684-b51a-424c-889b-1b8239dc8579 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.719058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdd684-b51a-424c-889b-1b8239dc8579 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:38.720579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdd684-b51a-424c-889b-1b8239dc8579 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:38.722578 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 48/111] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:38 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:38.723848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab04b-7724-43a2-9433-ebc18a456f08 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.724242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab04b-7724-43a2-9433-ebc18a456f08 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.724515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cab04b-7724-43a2-9433-ebc18a456f08 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.725952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 49/112] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:38.729031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cab04b-7724-43a2-9433-ebc18a456f08 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:38.798075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8456c-b163-49b6-b90f-a7dd416bfda7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:38.839960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799957e-669e-402b-9240-303ce4112d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:38.840592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799957e-669e-402b-9240-303ce4112d68 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.840983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799957e-669e-402b-9240-303ce4112d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.841260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799957e-669e-402b-9240-303ce4112d68 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.841943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799957e-669e-402b-9240-303ce4112d68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:38.842250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799957e-669e-402b-9240-303ce4112d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:38.843671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799957e-669e-402b-9240-303ce4112d68 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:38.849372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cab04b-7724-43a2-9433-ebc18a456f08 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:38.853761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 64/113] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:38.855135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fbad1-7861-4ad8-9f28-ce8ffad9976c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.855545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fbad1-7861-4ad8-9f28-ce8ffad9976c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.855965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fbad1-7861-4ad8-9f28-ce8ffad9976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.875557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-376fbad1-7861-4ad8-9f28-ce8ffad9976c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:38.877122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-376fbad1-7861-4ad8-9f28-ce8ffad9976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:38.888668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d0eed-55fb-4fd5-bfda-2e6f76bea3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:38.889290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0eed-55fb-4fd5-bfda-2e6f76bea3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.889573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0eed-55fb-4fd5-bfda-2e6f76bea3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.889846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d0eed-55fb-4fd5-bfda-2e6f76bea3a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.890694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0eed-55fb-4fd5-bfda-2e6f76bea3a0 None admin] RBAC: Adding query filter params (role.id=822b1d59d23e4939bfa9de27f135192a, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=ed3e53a309284b13838b795178694fe3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:38.891005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0eed-55fb-4fd5-bfda-2e6f76bea3a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:38.892624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d0eed-55fb-4fd5-bfda-2e6f76bea3a0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:38.903408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 50/114] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:38 2022] GET /identity/v3/role_assignments?user.id=ed3e53a309284b13838b795178694fe3&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=822b1d59d23e4939bfa9de27f135192a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:38.903408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597789-8f5d-4af9-bea8-4cdc1d11ec34 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.903408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597789-8f5d-4af9-bea8-4cdc1d11ec34 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.903408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597789-8f5d-4af9-bea8-4cdc1d11ec34 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.903408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 51/115] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:38.903408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea59c2-7ea0-4d7a-9983-5c8c597edc5e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.903939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea59c2-7ea0-4d7a-9983-5c8c597edc5e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.903939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea59c2-7ea0-4d7a-9983-5c8c597edc5e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:38.906123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 52/116] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:38.906123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea59c2-7ea0-4d7a-9983-5c8c597edc5e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:38.916749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:38.960259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:38.976311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 65/117] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:38.978480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0378a0-76b8-4aa7-b335-b04f5952d14c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:38.978767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0378a0-76b8-4aa7-b335-b04f5952d14c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:38.979314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0378a0-76b8-4aa7-b335-b04f5952d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.004463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ae0378a0-76b8-4aa7-b335-b04f5952d14c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:39.006024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ae0378a0-76b8-4aa7-b335-b04f5952d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:39.028732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea59c2-7ea0-4d7a-9983-5c8c597edc5e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:39.076496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4894c16-6d4a-44b0-8116-3726ef3e8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:39.077764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894c16-6d4a-44b0-8116-3726ef3e8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:39.078283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894c16-6d4a-44b0-8116-3726ef3e8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:39.078907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4894c16-6d4a-44b0-8116-3726ef3e8bb9 None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.080636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894c16-6d4a-44b0-8116-3726ef3e8bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:39.082295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4894c16-6d4a-44b0-8116-3726ef3e8bb9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:39.085173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 53/118] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:38 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:39.087100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdf16-b846-48d9-b5f7-d6fd1fb00b45 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:39.087829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdf16-b846-48d9-b5f7-d6fd1fb00b45 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:39.088278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecdf16-b846-48d9-b5f7-d6fd1fb00b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.099455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 66/119] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:39.100690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0378a0-76b8-4aa7-b335-b04f5952d14c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:39.135933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-57ecdf16-b846-48d9-b5f7-d6fd1fb00b45 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:39.137595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-57ecdf16-b846-48d9-b5f7-d6fd1fb00b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:39.287935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:39.289051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0378a0-76b8-4aa7-b335-b04f5952d14c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:39.289715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 54/120] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:39.353396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:39.354052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:39.354348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:39.354609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.355811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:39.357273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:39.358936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 67/121] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:39 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:39.365155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecdf16-b846-48d9-b5f7-d6fd1fb00b45 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:39.378855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:39.442084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:39.527605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1698d8-6ed7-48e5-adaf-9992bb2062bc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:39.561844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:39.562982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:39.564545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:39.564956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.582803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecdf16-b846-48d9-b5f7-d6fd1fb00b45 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:39.586996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:39.593810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:39.594871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:39.595810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:39.598831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 68/122] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:39.599943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:39.640049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:39.661501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:39.662484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:39.664130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:39.664537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/27b4b0f5a0a64a95ab7d44d3b0daadb4/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.670528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31ea6f15646e89ac43281f13adb53, user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:39.672192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:39.692241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 55/123] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:39 2022] PUT /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/27b4b0f5a0a64a95ab7d44d3b0daadb4/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:25:39.693864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:39.823647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:39.828521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c44c5-446f-4118-9b88-5d5b83f7f0a6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:39.838273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a7333-a1ad-45d6-9f63-8d75f6387a08 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:39.874591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:39.876171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:39.876652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:39.877472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.878512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:39.879312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:39.881363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:39.904965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 56/124] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:39.905299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:39.906008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:39.906930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:39.907461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:39.907839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:39.929488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:39.936885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:39.937739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:39.938491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 69/125] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:39.939109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.063822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238912-18fc-438d-881a-af9a130b8fe4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.091180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:40.103480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.104822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.105313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.106389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.108002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:40.109675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:40.111914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 70/126] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:39 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:40.113042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.214155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff1f59-ee16-4ceb-8aed-7de966fc2bdc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.252566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719aac-c472-4319-b79a-3d5864a5fce8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.280389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.281367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.281886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.282375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.302164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:40.308546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:40.309415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:40.310191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:40.316979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 57/127] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:40.324213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.327554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.328794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.331010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.331481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.332403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:40.332914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:40.334787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:40.351860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 71/128] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:40.352964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.377652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:40.380160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:40.506544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8708f9-2692-490a-a450-6fdcc406d01a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.546342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.547371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.547899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.548388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.549319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:40.549820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:40.551414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:40.562245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 72/129] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:25:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:40.567649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.577589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd45a-002f-4545-8433-446e535ae98a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.644419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.645704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.646974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.647682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] PATH_INFO: `/v3/projects/9fb64fd78cd444f5a7f1075a123a9599` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.650485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] RBAC: Authorizing `identity:get_project(project_id=9fb64fd78cd444f5a7f1075a123a9599)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:40.653413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:40.656212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 58/130] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:40 2022] GET /identity/v3/projects/9fb64fd78cd444f5a7f1075a123a9599 => generated 312 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:40.659621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.705661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:40.741106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c204d11-875d-4065-80ec-90487f7c7e2b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.775474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.776156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.776440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.776716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] PATH_INFO: `/v3/users/2d40cc5420f2410681feb8bd4176552c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.777843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] RBAC: Authorizing `identity:get_user(user_id=2d40cc5420f2410681feb8bd4176552c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:40.782010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:40.782010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 73/131] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:40 2022] GET /identity/v3/users/2d40cc5420f2410681feb8bd4176552c => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:40.782010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.831609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:40.867913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe058b-c14e-4f74-abeb-73f2fae3b2db None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.892915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad42bac-4de2-4cb5-865b-2672491dfd24 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:40.936912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.937494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.937997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.938272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.940409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:40.941880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:40.944837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 59/132] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:40 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:40.946958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.950978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:40.951873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:40.952153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:40.952429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] PATH_INFO: `/v3/projects/9fb64fd78cd444f5a7f1075a123a9599/users/27b4b0f5a0a64a95ab7d44d3b0daadb4/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:40.956256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb64fd78cd444f5a7f1075a123a9599, user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:40.957727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:40.987301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 74/133] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:40 2022] PUT /identity/v3/projects/9fb64fd78cd444f5a7f1075a123a9599/users/27b4b0f5a0a64a95ab7d44d3b0daadb4/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:25:40.988303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:40.991965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:41.125770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18460324-a7c6-4e6d-b649-0224c34c1f14 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:41.166818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0fc09-c437-443a-9ba2-d9f1a70a43d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:41.167482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0fc09-c437-443a-9ba2-d9f1a70a43d8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.167746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27de80c-5fe4-4cd5-8487-4f07f028350a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:41.167851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0fc09-c437-443a-9ba2-d9f1a70a43d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.168090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0fc09-c437-443a-9ba2-d9f1a70a43d8 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.169444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0fc09-c437-443a-9ba2-d9f1a70a43d8 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:41.171048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0fc09-c437-443a-9ba2-d9f1a70a43d8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:41.172838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 60/134] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:40 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:41.174111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc26f-cc86-43ed-a3e8-14618d54e7bc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.174407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc26f-cc86-43ed-a3e8-14618d54e7bc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.174691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc26f-cc86-43ed-a3e8-14618d54e7bc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.176362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 61/135] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:41.177697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad82c33-ee25-4877-bb99-01ecbaf2d82e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.177986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad82c33-ee25-4877-bb99-01ecbaf2d82e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.178263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad82c33-ee25-4877-bb99-01ecbaf2d82e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.179883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 62/136] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:41.183860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad82c33-ee25-4877-bb99-01ecbaf2d82e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:41.212758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:41.218559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8635d9-b2da-430d-9ed9-dce83053b446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:41.219213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8635d9-b2da-430d-9ed9-dce83053b446 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.219498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8635d9-b2da-430d-9ed9-dce83053b446 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.219960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8635d9-b2da-430d-9ed9-dce83053b446 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.221134 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8635d9-b2da-430d-9ed9-dce83053b446 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:41.222548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8635d9-b2da-430d-9ed9-dce83053b446 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:41.225433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 75/137] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:40 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:41.225693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7b0b3-ed25-4f7c-b5bb-b3f169f6a0c8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.226255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7b0b3-ed25-4f7c-b5bb-b3f169f6a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.226255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7b0b3-ed25-4f7c-b5bb-b3f169f6a0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.254273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-25a7b0b3-ed25-4f7c-b5bb-b3f169f6a0c8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:41.255792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-25a7b0b3-ed25-4f7c-b5bb-b3f169f6a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:41.302948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad82c33-ee25-4877-bb99-01ecbaf2d82e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:41.325502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 76/138] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:41.326837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453293-2ce0-402f-9b4d-716f47c760e9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.327172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453293-2ce0-402f-9b4d-716f47c760e9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.327455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453293-2ce0-402f-9b4d-716f47c760e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.335933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:41.347296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-81453293-2ce0-402f-9b4d-716f47c760e9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:41.348893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-81453293-2ce0-402f-9b4d-716f47c760e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:41.400882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:41.401582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.401871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.402151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/2d40cc5420f2410681feb8bd4176552c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.404130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31ea6f15646e89ac43281f13adb53, user_id=2d40cc5420f2410681feb8bd4176552c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:41.405616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:41.431623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 77/139] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:41.432645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453293-2ce0-402f-9b4d-716f47c760e9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:41.462881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 63/140] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:41 2022] PUT /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/2d40cc5420f2410681feb8bd4176552c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:25:41.549271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453293-2ce0-402f-9b4d-716f47c760e9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:41.583158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:41.590407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:41.591158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.591456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.591762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/27b4b0f5a0a64a95ab7d44d3b0daadb4/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.594475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31ea6f15646e89ac43281f13adb53, user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4, role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:41.596031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:41.613082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 78/141] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:41 2022] PUT /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/27b4b0f5a0a64a95ab7d44d3b0daadb4/roles/66545c4116b74dad93fef433e2619ef8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:25:41.787513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:41.886306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:41.908012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1915d-9ed7-4f00-9897-804359ed7fc0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:41.922122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:41.953719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:41.954378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:41.954662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:41.954936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:41.988956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:41.995014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:41.995905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:41.996658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 64/142] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:42.005212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:42.103758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11023ac9-e5b5-4471-bd54-9c6e9a1a91c8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:42.144849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19710976-791b-4ea9-ad07-8e928357ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:42.145592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19710976-791b-4ea9-ad07-8e928357ec3e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.145938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19710976-791b-4ea9-ad07-8e928357ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.146995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19710976-791b-4ea9-ad07-8e928357ec3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.148244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19710976-791b-4ea9-ad07-8e928357ec3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:42.149770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19710976-791b-4ea9-ad07-8e928357ec3e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:42.151616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 79/143] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:42.152800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721ac1-6156-48e8-b096-26e732f2aa9d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.153086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721ac1-6156-48e8-b096-26e732f2aa9d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.153359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721ac1-6156-48e8-b096-26e732f2aa9d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.154872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 80/144] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:42.159917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435548-82e7-47f2-ac16-b095f6107537 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.160202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435548-82e7-47f2-ac16-b095f6107537 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.160475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8435548-82e7-47f2-ac16-b095f6107537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.194392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b8435548-82e7-47f2-ac16-b095f6107537 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:42.195063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b8435548-82e7-47f2-ac16-b095f6107537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:42.226032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18a9d3-a809-41b0-92fb-c255f2c6f4ba None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:42.294964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:42.299980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:42.300676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.300961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.301236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.301925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:42.302325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:42.304456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:42.313781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 81/145] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:42.314671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435548-82e7-47f2-ac16-b095f6107537 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:42.333925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 65/146] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:42.339499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:42.358877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:42.490156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45276a8-b45a-41ab-b054-374f7c698b20 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:42.516311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8435548-82e7-47f2-ac16-b095f6107537 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:42.526690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:42.527346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.527658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.527935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] PATH_INFO: `/v3/users/ed3e53a309284b13838b795178694fe3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.529138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3e53a309284b13838b795178694fe3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:42.530618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:42.532628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 66/147] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:42 2022] GET /identity/v3/users/ed3e53a309284b13838b795178694fe3 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:42.538636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:42.581880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:42.582973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.583293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.583598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.584288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:42.585768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:42.610394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 82/148] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:25:42 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:42.711900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:42.749159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4b368-becb-4e74-ac7c-37c3ebefb565 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:42.802191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:42.803359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.803697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.803987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.805133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:42.806668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:42.808369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 67/149] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:42 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:42.814263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:42.872123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:42.939345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7f8bd-ac8f-44d1-bbff-ed11864b82ce None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:42.944644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:42.981847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:42.982581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:42.982868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:42.983144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/ed3e53a309284b13838b795178694fe3/roles/822b1d59d23e4939bfa9de27f135192a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:42.985230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31ea6f15646e89ac43281f13adb53, user_id=ed3e53a309284b13838b795178694fe3, role_id=822b1d59d23e4939bfa9de27f135192a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:42.986743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:43.010414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 83/150] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:42 2022] PUT /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53/users/ed3e53a309284b13838b795178694fe3/roles/822b1d59d23e4939bfa9de27f135192a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:25:43.108216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a6dd-e8f8-4f70-aff1-8adf8c3b4b12 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:43.159402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:43.160010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:43.160355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:43.160638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:43.178493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:43.184041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:43.185134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:43.185885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 68/151] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:25:43.193849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:43.320215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9fde-a1ef-4372-9255-c3f960a90285 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:43.322694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:43.359313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:43.359978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:43.360260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:43.360533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:43.361206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:43.361509 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:43.362928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:43.374321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 84/152] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:43.380365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:43.384083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:43.528234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42355a6-1a62-4ad6-bc79-ddb829e501c1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:43.590486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:43.591142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:43.592042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:43.592042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:43.592973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:43.594436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:43.596389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 69/153] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:43 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:43.602953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:43.724536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b89e0-5ad5-496c-b490-6984ad0cf921 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:43.773505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a5547-5f65-4370-885d-0669acc6d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:43.774147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a5547-5f65-4370-885d-0669acc6d5cc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:43.774425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a5547-5f65-4370-885d-0669acc6d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:43.774695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a5547-5f65-4370-885d-0669acc6d5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:43.843999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:43.879438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a5547-5f65-4370-885d-0669acc6d5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:43.881058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a5547-5f65-4370-885d-0669acc6d5cc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:44.031356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 85/154] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:44.042116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:44.080512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5d967-3626-4ef8-bef6-5938832e37da None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:44.080827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5d967-3626-4ef8-bef6-5938832e37da None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:44.081065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5d967-3626-4ef8-bef6-5938832e37da None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:44.082441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 86/155] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:44.092400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c9e0b-cfe2-4cfa-a96b-f2629456f246 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:44.092680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c9e0b-cfe2-4cfa-a96b-f2629456f246 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:44.092965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c9e0b-cfe2-4cfa-a96b-f2629456f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:44.125004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-303c9e0b-cfe2-4cfa-a96b-f2629456f246 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:44.126099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-303c9e0b-cfe2-4cfa-a96b-f2629456f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:44.178091 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:44.217409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b412821-7fc8-412f-8ba9-1c15efde5acc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:44.260558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:44.269291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:44.269956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:44.270254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:44.270532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:44.271952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:44.273351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:44.275043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 70/156] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:44 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:44.277412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 87/157] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:44.286587 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:44.307220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8abeb8-96aa-4586-9de6-85c25fe3c4ac None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:44.307514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8abeb8-96aa-4586-9de6-85c25fe3c4ac None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:44.307828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8abeb8-96aa-4586-9de6-85c25fe3c4ac None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:44.310481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 88/158] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:44.315849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb98ba-61f6-402d-b7f1-12c6c8d2339b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:44.316133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb98ba-61f6-402d-b7f1-12c6c8d2339b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:44.316402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb98ba-61f6-402d-b7f1-12c6c8d2339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:44.342129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-42bb98ba-61f6-402d-b7f1-12c6c8d2339b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:44.343335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-42bb98ba-61f6-402d-b7f1-12c6c8d2339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:44.422986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 89/159] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:44.479279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97be7-ad70-481b-beb3-26d548ce3632 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:44.532338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:44.532971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:44.533250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:44.533521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:44.534273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:44.534580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:44.536066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:44.543205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 71/160] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:44 2022] GET /identity/v3/role_assignments?user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:44.678739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb98ba-61f6-402d-b7f1-12c6c8d2339b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:44.794679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb98ba-61f6-402d-b7f1-12c6c8d2339b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:44.822569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:44.832058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:44.832935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:44.833211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:44.833628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:44.845903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:44.851168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:44.852119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:44.852926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 90/161] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:44.858472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:44.861473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:44.957546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:44.968408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89080de0-9031-4cc7-9554-1cf22f68648c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:45.057642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ef257-f7f0-4399-8f7a-c005f2bf13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:45.058657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef257-f7f0-4399-8f7a-c005f2bf13a8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.059134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef257-f7f0-4399-8f7a-c005f2bf13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.059646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ef257-f7f0-4399-8f7a-c005f2bf13a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.060545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ef257-f7f0-4399-8f7a-c005f2bf13a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:45.061045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ef257-f7f0-4399-8f7a-c005f2bf13a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:45.062699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ef257-f7f0-4399-8f7a-c005f2bf13a8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:45.070039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b442221-66f9-4cf1-a672-180a3c35eaba None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:45.081828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 72/162] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:45.093126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594788bf-b86c-402f-a2e6-a07faefe0ed3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.093750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594788bf-b86c-402f-a2e6-a07faefe0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.094220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594788bf-b86c-402f-a2e6-a07faefe0ed3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.095837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 73/163] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:45.096724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594788bf-b86c-402f-a2e6-a07faefe0ed3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:45.112607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f0729-2d07-4c58-871f-0ccc3564c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:45.113249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f0729-2d07-4c58-871f-0ccc3564c870 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.113522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f0729-2d07-4c58-871f-0ccc3564c870 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.113786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f0729-2d07-4c58-871f-0ccc3564c870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.125309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f0729-2d07-4c58-871f-0ccc3564c870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-215f0729-2d07-4c58-871f-0ccc3564c870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:45.131456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:45.132411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:45.133208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 91/164] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:25:45.134385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ea45-a0fc-4561-838d-1b11e8e2ddab None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.134385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ea45-a0fc-4561-838d-1b11e8e2ddab None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.134529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ea45-a0fc-4561-838d-1b11e8e2ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.156239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b648ea45-a0fc-4561-838d-1b11e8e2ddab None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:45.157682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b648ea45-a0fc-4561-838d-1b11e8e2ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:45.235034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 92/165] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:45.235930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ea45-a0fc-4561-838d-1b11e8e2ddab None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:45.239910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:45.272308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:45.344575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ea45-a0fc-4561-838d-1b11e8e2ddab None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:45.360287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594788bf-b86c-402f-a2e6-a07faefe0ed3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:45.382571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:45.383356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.383534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.383835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.384505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:45.384804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:45.386195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:45.399604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 93/166] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:45.402573 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:45.422869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:45.423611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.423892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.424159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.425739 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:45.430440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:45.438250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 74/167] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:45 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:45.454905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:45.492453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:45.601919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370f8af-5280-48ff-ab2d-31cfb31be966 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:45.646550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cdcdb-b57e-4802-b337-c03ee8fda8c3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:45.653468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:45.654118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.654392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.654658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] PATH_INFO: `/v3/users/2d40cc5420f2410681feb8bd4176552c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.655941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] RBAC: Authorizing `identity:get_user(user_id=2d40cc5420f2410681feb8bd4176552c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:45.661808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:45.663753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 94/168] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:45 2022] GET /identity/v3/users/2d40cc5420f2410681feb8bd4176552c => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:45.671164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:45.711792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:45.722644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:45.723263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.723539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.723831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:45.856921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:45.858420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:45.862313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a21b58-8b55-42ad-a2af-26ec079c0203 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:45.878172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:45.927593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:45.928627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:45.929101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:45.929563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.025969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 75/169] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:25:46.027151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:46.047010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:46.048543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:46.099989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:46.153150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 95/170] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:46.154374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:46.163152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:46.192460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442b4ed-ad11-42e3-ba69-bfe2d37a3aa1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:46.261021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dc422-c1e3-41a9-9c44-3a34f5fdb979 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:46.261923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:46.262690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.263073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.263464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.284903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:46.298819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:46.299796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 76/171] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:25:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:46.300590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:46.309753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:46.309753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.309753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.309753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] PATH_INFO: `/v3/projects/9fb64fd78cd444f5a7f1075a123a9599` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.310327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] RBAC: Authorizing `identity:get_project(project_id=9fb64fd78cd444f5a7f1075a123a9599)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:46.315630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:46.315630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 96/172] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:46 2022] GET /identity/v3/projects/9fb64fd78cd444f5a7f1075a123a9599 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:46.320693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:46.429381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:46.494191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c974d-84c6-400c-8a53-4a7d0330f8ab None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:46.508543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:46.518860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8529091-90c4-4abc-8194-73c9c59b4d88 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:46.560802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:46.561440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.561720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.561997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.566186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:46.567677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:46.569550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 77/173] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:46 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:46.570333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:46.579536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b63d5-71c7-4ba6-b2a0-12e4201d40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:46.580190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b63d5-71c7-4ba6-b2a0-12e4201d40f4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.580466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b63d5-71c7-4ba6-b2a0-12e4201d40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.580732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b63d5-71c7-4ba6-b2a0-12e4201d40f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.581406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b63d5-71c7-4ba6-b2a0-12e4201d40f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:46.581706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b63d5-71c7-4ba6-b2a0-12e4201d40f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:46.583106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b63d5-71c7-4ba6-b2a0-12e4201d40f4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:46.602453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 97/174] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:25:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:46.603757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd552-24a4-4b51-abbc-755746911a4d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.604043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd552-24a4-4b51-abbc-755746911a4d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.604313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd552-24a4-4b51-abbc-755746911a4d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.612109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 98/175] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:46.612705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd552-24a4-4b51-abbc-755746911a4d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:46.736918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd552-24a4-4b51-abbc-755746911a4d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:46.779403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:46.780059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.780337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.780610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.781500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=2d40cc5420f2410681feb8bd4176552c) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:46.781815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:46.783892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:46.787549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:46.792751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60670460-9fbf-445f-9ef9-b1fe498e6e51 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:46.793110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 99/176] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:46 2022] GET /identity/v3/role_assignments?user.id=2d40cc5420f2410681feb8bd4176552c&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:46.799609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:46.875226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb13c3c-1735-44e0-81d4-a9a9d88aed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:46.875880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13c3c-1735-44e0-81d4-a9a9d88aed60 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.876162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13c3c-1735-44e0-81d4-a9a9d88aed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.876441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb13c3c-1735-44e0-81d4-a9a9d88aed60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.877833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb13c3c-1735-44e0-81d4-a9a9d88aed60 None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=9fb64fd78cd444f5a7f1075a123a9599, user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:46.878138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb13c3c-1735-44e0-81d4-a9a9d88aed60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:46.884885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb13c3c-1735-44e0-81d4-a9a9d88aed60 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:46.897158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 78/177] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:46 2022] GET /identity/v3/role_assignments?user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4&scope.project.id=9fb64fd78cd444f5a7f1075a123a9599&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:46.898462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82eb4-d2af-4269-a99a-d2fe8fc858b6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:46.905942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82eb4-d2af-4269-a99a-d2fe8fc858b6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:46.906337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82eb4-d2af-4269-a99a-d2fe8fc858b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:46.947111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e4a82eb4-d2af-4269-a99a-d2fe8fc858b6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:46.949476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e4a82eb4-d2af-4269-a99a-d2fe8fc858b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:46.975274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:47.032144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 79/178] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:47.033404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d6ede-9b48-4119-b3f2-4a22a2782641 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.033696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d6ede-9b48-4119-b3f2-4a22a2782641 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.034010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d6ede-9b48-4119-b3f2-4a22a2782641 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.035764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 80/179] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:47.040034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee1c6a-9be8-4db5-9a80-fdf826712a56 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:47.042643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228603-335d-4fa8-9278-885b5e6d5d8b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.042927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228603-335d-4fa8-9278-885b5e6d5d8b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.043199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae228603-335d-4fa8-9278-885b5e6d5d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.077475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ae228603-335d-4fa8-9278-885b5e6d5d8b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:47.078719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ae228603-335d-4fa8-9278-885b5e6d5d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:47.107185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:47.108235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.108517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.108791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] PATH_INFO: `/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.112997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] RBAC: Authorizing `identity:get_user(user_id=27b4b0f5a0a64a95ab7d44d3b0daadb4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:47.114973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:47.117276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 100/180] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:46 2022] GET /identity/v3/users/27b4b0f5a0a64a95ab7d44d3b0daadb4 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:47.124578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:47.186316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 81/181] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:47.219890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:47.263715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50808204-9b57-4d86-933f-2109a1123b5f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:47.303306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:47.303960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.304239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.304512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.383740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:47.385222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:47.456883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:47.503295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 101/182] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:47.509105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228603-335d-4fa8-9278-885b5e6d5d8b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:47.531458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:47.610922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:47.627255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae228603-335d-4fa8-9278-885b5e6d5d8b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:47.663866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db741-89e4-4092-abbc-9210ec594984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:47.664550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db741-89e4-4092-abbc-9210ec594984 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.664929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db741-89e4-4092-abbc-9210ec594984 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.665171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db741-89e4-4092-abbc-9210ec594984 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.666365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db741-89e4-4092-abbc-9210ec594984 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:47.667863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776db741-89e4-4092-abbc-9210ec594984 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:47.669536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 82/183] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:47 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:47.670660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b695-71c5-4b51-9c07-7cd7e5a20075 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.670944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b695-71c5-4b51-9c07-7cd7e5a20075 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.671216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3b695-71c5-4b51-9c07-7cd7e5a20075 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.672429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 83/184] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:47.673425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865173-08e1-4727-98f4-bf2440cd2545 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.673701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865173-08e1-4727-98f4-bf2440cd2545 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.674062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865173-08e1-4727-98f4-bf2440cd2545 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.675242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 84/185] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:47.677248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e486647-3eb0-4027-a7bb-aa3a3a336cb6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:47.677507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865173-08e1-4727-98f4-bf2440cd2545 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:47.712287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:47.713658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.713933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.714200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.724344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:47.729042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:47.730056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:47.730863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 102/186] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:25:47.731554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:47.763359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:47.782230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865173-08e1-4727-98f4-bf2440cd2545 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:47.816939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffae4c-2d4b-45ca-b27c-db3649dac03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:47.817558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffae4c-2d4b-45ca-b27c-db3649dac03b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.817894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffae4c-2d4b-45ca-b27c-db3649dac03b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.818164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffae4c-2d4b-45ca-b27c-db3649dac03b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.828266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffae4c-2d4b-45ca-b27c-db3649dac03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-93ffae4c-2d4b-45ca-b27c-db3649dac03b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:47.832958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:47.833960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:47.834986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 85/187] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:47.835946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d3d7-fd64-4583-84c5-873472c920c4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.835946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d3d7-fd64-4583-84c5-873472c920c4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.835946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d3d7-fd64-4583-84c5-873472c920c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.841924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300a667-abbd-4a08-a054-62f6a5cfdeed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:47.853352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-29c2d3d7-fd64-4583-84c5-873472c920c4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:47.854548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-29c2d3d7-fd64-4583-84c5-873472c920c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:47.862086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:47.878925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c51a77-87eb-44d4-8b6c-0a218d1d1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:47.879540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c51a77-87eb-44d4-8b6c-0a218d1d1558 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.879857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c51a77-87eb-44d4-8b6c-0a218d1d1558 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.880124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c51a77-87eb-44d4-8b6c-0a218d1d1558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.880959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c51a77-87eb-44d4-8b6c-0a218d1d1558 None admin] RBAC: Adding query filter params (role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:47.881256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c51a77-87eb-44d4-8b6c-0a218d1d1558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:47.882707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c51a77-87eb-44d4-8b6c-0a218d1d1558 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:47.888474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 103/188] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:47 2022] GET /identity/v3/role_assignments?user.id=27b4b0f5a0a64a95ab7d44d3b0daadb4&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=66545c4116b74dad93fef433e2619ef8 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:47.889665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7552d5-4b74-415b-be38-570814a63164 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:47.889943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7552d5-4b74-415b-be38-570814a63164 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:47.890210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7552d5-4b74-415b-be38-570814a63164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:47.909586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fd7552d5-4b74-415b-be38-570814a63164 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:47.910819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fd7552d5-4b74-415b-be38-570814a63164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:47.937732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 86/189] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:47.945016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d3d7-fd64-4583-84c5-873472c920c4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:47.996080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 104/190] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:47.997302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7552d5-4b74-415b-be38-570814a63164 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.046398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.084289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d3d7-fd64-4583-84c5-873472c920c4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.138707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.139247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.139524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.139833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.140492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:48.140793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.142176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.152827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 87/191] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:48.159011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.162999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7552d5-4b74-415b-be38-570814a63164 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.163984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.207300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.207929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.208206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.208580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.209248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:48.209546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.211041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.220460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 105/192] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:48.228490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.276771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33143a0f-38a3-405b-ab6a-4ff523e6ae50 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.315438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.316114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.316393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.316661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] PATH_INFO: `/v3/users/ed3e53a309284b13838b795178694fe3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.317911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3e53a309284b13838b795178694fe3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.319409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.320782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.321128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 88/193] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:48 2022] GET /identity/v3/users/ed3e53a309284b13838b795178694fe3 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:48.321884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.340864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a034e-80e4-417f-ba11-dc32c87ed8ac None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.374468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.375098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.375372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.375666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.376763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.378558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.380205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 106/194] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:48.381202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.394054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.423429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acfb32-6e31-4e25-8d0b-213417467b72 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.456019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.456654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.456988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.457268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] PATH_INFO: `/v3/users/dc513af15d87491990f538f6494c20ce` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.470905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] RBAC: Authorizing `identity:get_user(user_id=dc513af15d87491990f538f6494c20ce)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.472405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.474099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 89/195] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:48 2022] GET /identity/v3/users/dc513af15d87491990f538f6494c20ce => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:48.474872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.484335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4a4ca-448a-45b6-ba2d-0b3fc40af1ac None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.519296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.519973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.520245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.520512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.530619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:48.535696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:48.536630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:48.537409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 107/196] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:25:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:48.538058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.553473 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.576653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da1516-bcc9-4cce-a35d-e553d0e78f7d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.606383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.612712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.613325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.613601 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.613926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.638912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99383d40-2b64-4ccb-8f37-c36efa9ac91e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.674567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.675116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.675397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.675712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.676370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.677984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.686649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.688134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.699838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 108/197] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:25:48 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:48.700914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.789933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.823094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 90/198] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:48.823935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:48.837486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad519915-ec1c-46ad-9309-591a36487e08 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.857948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:48.878263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.878884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.879162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.879429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.941590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8e3b-c4a4-41da-8b20-2ac9499d5a65 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:48.963214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.964821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:48.986227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:48.986852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:48.987134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:48.987471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:48.988376 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:48.988682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:48.990505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.003117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 91/199] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:25:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:49.003293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:49.048405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:49.093640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 109/200] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:49.094502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:49.119287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:49.133193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a891fb2-d845-4784-af74-e2afb77bb807 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:49.171458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:49.172453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:49.172900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:49.173481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:49.174782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:49.176436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.178349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 92/201] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:49 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:49.179456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:49.205943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b93d-db60-43ae-b620-0f997ccbfc85 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:49.243841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:49.244498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:49.244774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:49.245042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] PATH_INFO: `/v3/users/dc513af15d87491990f538f6494c20ce` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:49.246352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] RBAC: Authorizing `identity:get_user(user_id=dc513af15d87491990f538f6494c20ce)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:49.247999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.249955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 110/202] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:49 2022] GET /identity/v3/users/dc513af15d87491990f538f6494c20ce => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:49.250965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:49.290311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:49.313021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931339f-7e08-44c2-b088-560911448f1f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:49.360759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:49.361962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:49.362674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:49.363556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:49.365284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:49.366242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd32cf-f92f-4a12-a662-a772ca9adb95 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:49.367215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.370398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 93/203] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:49 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:49.371386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:49.406356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:49.407019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:49.407300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:49.407570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:49.408344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] RBAC: Adding query filter params (role.id=822b1d59d23e4939bfa9de27f135192a, scope.project.id=2ea31ea6f15646e89ac43281f13adb53, user.id=ed3e53a309284b13838b795178694fe3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:49.408649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:49.409428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:49.410198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.423682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 111/204] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:49 2022] GET /identity/v3/role_assignments?user.id=ed3e53a309284b13838b795178694fe3&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=822b1d59d23e4939bfa9de27f135192a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:49.424710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:49.579390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:49.583934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4e41a-c0fe-4238-a281-7b36fa96dd9f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:49.586390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e39e-cef5-4a87-b34f-bdec3f7093ef None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:49.624596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:49.625559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:49.626158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:49.626622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:49.627935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=dc513af15d87491990f538f6494c20ce) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:49.628611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:49.629631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:49.630281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:49.630563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:49.630833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:49.631298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.637630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 112/205] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:49 2022] GET /identity/v3/role_assignments?user.id=dc513af15d87491990f538f6494c20ce&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:49.715112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:49.717365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.749610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:49.837990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 94/206] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:49.843735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:49.953994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375793b0-6f60-45da-8476-2ba7cbd2dfae None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:49.991219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c789daf-2a9e-459b-a5b4-5d3033122fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:49.992290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c789daf-2a9e-459b-a5b4-5d3033122fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:49.992765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c789daf-2a9e-459b-a5b4-5d3033122fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:49.993229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c789daf-2a9e-459b-a5b4-5d3033122fa2 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:49.994632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c789daf-2a9e-459b-a5b4-5d3033122fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:49.996368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c789daf-2a9e-459b-a5b4-5d3033122fa2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:49.998606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 113/207] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:49 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:50.004595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:50.111559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7cd7-b2c2-48ac-b86e-1714d1ebd329 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:50.143659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:50.154560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37001-46ea-4d55-9105-d2d279e91d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:50.155433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37001-46ea-4d55-9105-d2d279e91d42 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:50.155957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37001-46ea-4d55-9105-d2d279e91d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:50.156426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37001-46ea-4d55-9105-d2d279e91d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:50.157456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37001-46ea-4d55-9105-d2d279e91d42 None admin] RBAC: Adding query filter params (role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=dc513af15d87491990f538f6494c20ce) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:50.157980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37001-46ea-4d55-9105-d2d279e91d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:50.159650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37001-46ea-4d55-9105-d2d279e91d42 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:50.167973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 95/208] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:50 2022] GET /identity/v3/role_assignments?user.id=dc513af15d87491990f538f6494c20ce&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=66545c4116b74dad93fef433e2619ef8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:50.863884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef62f-993e-4dcd-9dad-1d12967e8502 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:50.864404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef62f-993e-4dcd-9dad-1d12967e8502 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:50.864404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef62f-993e-4dcd-9dad-1d12967e8502 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:50.865968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 114/209] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:50.868996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf300-c1f8-4507-8f66-f1e94b6d2040 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:50.869395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf300-c1f8-4507-8f66-f1e94b6d2040 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:50.869608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaf300-c1f8-4507-8f66-f1e94b6d2040 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:50.872055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff23d59-148e-4ab6-921c-4d2b34d44653 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:50.872335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff23d59-148e-4ab6-921c-4d2b34d44653 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:50.872605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff23d59-148e-4ab6-921c-4d2b34d44653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:50.875284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 96/210] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:50.876729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6ebe-1e02-42a1-8f23-13e9c4223442 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:50.877371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6ebe-1e02-42a1-8f23-13e9c4223442 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:50.877645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6ebe-1e02-42a1-8f23-13e9c4223442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:50.892783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cff23d59-148e-4ab6-921c-4d2b34d44653 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:50.894254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cff23d59-148e-4ab6-921c-4d2b34d44653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:50.895770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-60dc6ebe-1e02-42a1-8f23-13e9c4223442 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:50.897089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-60dc6ebe-1e02-42a1-8f23-13e9c4223442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:50.924086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:50.975681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 115/211] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:50.977805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 97/212] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:51.235737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff23d59-148e-4ab6-921c-4d2b34d44653 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:51.242455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6ebe-1e02-42a1-8f23-13e9c4223442 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:51.356296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff23d59-148e-4ab6-921c-4d2b34d44653 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:51.361193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6ebe-1e02-42a1-8f23-13e9c4223442 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:51.387136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:51.402096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:51.402911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.403024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:51.403451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.403828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.404054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:51.404288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.404649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:51.405595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:51.407198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:51.409057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 98/213] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:51.414684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:51.416873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:51.422988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:51.423923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:51.424697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:51.427662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 116/214] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:51.432973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:51.464355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:51.543505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69759-69ef-425e-8e08-46caa4187153 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:51.564345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b596e-71ad-423e-94ff-5de9f909f387 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:51.588663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425f51e-4e2f-457a-932c-830680f91086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:51.589281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425f51e-4e2f-457a-932c-830680f91086 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.589558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425f51e-4e2f-457a-932c-830680f91086 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.589826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425f51e-4e2f-457a-932c-830680f91086 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:51.591039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425f51e-4e2f-457a-932c-830680f91086 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:51.593093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425f51e-4e2f-457a-932c-830680f91086 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:51.605386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:51.606019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.606291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.606736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:51.607407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:51.607739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:51.609126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:51.621775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 117/215] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:51.628367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:51.635773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 99/216] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:25:51 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:25:51.670416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208cb61-7b50-4351-a1b1-208dff07fae1 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.670744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208cb61-7b50-4351-a1b1-208dff07fae1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.670972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208cb61-7b50-4351-a1b1-208dff07fae1 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:51.672700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 100/217] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:51.678545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1eadf-eeda-4989-9b62-d190ebfd70c7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.678871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1eadf-eeda-4989-9b62-d190ebfd70c7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.679098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1eadf-eeda-4989-9b62-d190ebfd70c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:51.699103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-82d1eadf-eeda-4989-9b62-d190ebfd70c7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:51.700396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-82d1eadf-eeda-4989-9b62-d190ebfd70c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:51.745580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:51.768758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:51.773307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a98a6f-2a63-4e4c-b0b9-510b93957479 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:51.805418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 101/218] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:51.819515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346579f8-222c-4219-9910-815c959f6309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:51.820200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346579f8-222c-4219-9910-815c959f6309 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.820482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346579f8-222c-4219-9910-815c959f6309 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.820753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346579f8-222c-4219-9910-815c959f6309 None admin] PATH_INFO: `/v3/users/750cb7c160ab471ca8eb856a77647087` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:51.838017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346579f8-222c-4219-9910-815c959f6309 None admin] RBAC: Authorizing `identity:get_user(user_id=750cb7c160ab471ca8eb856a77647087)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:51.839567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346579f8-222c-4219-9910-815c959f6309 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:51.841463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 118/219] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:51 2022] GET /identity/v3/users/750cb7c160ab471ca8eb856a77647087 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:51.847161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1eadf-eeda-4989-9b62-d190ebfd70c7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:51.951485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1eadf-eeda-4989-9b62-d190ebfd70c7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:51.991172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187e8ed-d906-4229-bbe7-794abbaf0bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:51.992228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187e8ed-d906-4229-bbe7-794abbaf0bcf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:51.992725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187e8ed-d906-4229-bbe7-794abbaf0bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:51.993220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187e8ed-d906-4229-bbe7-794abbaf0bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.041965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:52.069502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187e8ed-d906-4229-bbe7-794abbaf0bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:52.070930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187e8ed-d906-4229-bbe7-794abbaf0bcf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:52.085011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346579f8-222c-4219-9910-815c959f6309 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:52.194073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 102/220] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:52.195488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f7871-25c9-4df1-a5bb-fbdf5e735f9e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.195861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f7871-25c9-4df1-a5bb-fbdf5e735f9e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.196132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f7871-25c9-4df1-a5bb-fbdf5e735f9e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.197407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 103/221] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:52.202201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f7871-25c9-4df1-a5bb-fbdf5e735f9e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:52.218692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346579f8-222c-4219-9910-815c959f6309 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:52.263819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b370d-fc32-4fdd-9df4-bce7ae555e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:52.264468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b370d-fc32-4fdd-9df4-bce7ae555e5f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.264740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b370d-fc32-4fdd-9df4-bce7ae555e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.265005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b370d-fc32-4fdd-9df4-bce7ae555e5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.277690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b370d-fc32-4fdd-9df4-bce7ae555e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-cf6b370d-fc32-4fdd-9df4-bce7ae555e5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:52.282875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:52.283801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:52.284661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:52.286775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 119/222] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:25:52.288193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb515-d4b4-42ba-b665-649da9397029 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.288645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb515-d4b4-42ba-b665-649da9397029 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.289058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb515-d4b4-42ba-b665-649da9397029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.293701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:52.297927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:52.314362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cbabb515-d4b4-42ba-b665-649da9397029 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:52.316489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cbabb515-d4b4-42ba-b665-649da9397029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:52.326169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f7871-25c9-4df1-a5bb-fbdf5e735f9e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:52.369281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:52.370592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.371114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.371556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.373176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:52.375446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:52.378162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 104/223] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:52 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:52.379073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:52.401948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 120/224] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:52.403049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb515-d4b4-42ba-b665-649da9397029 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:52.527968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664816c1-116d-495c-ae34-6b7873701cfe None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:52.565268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb515-d4b4-42ba-b665-649da9397029 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:52.569328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:52.569955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.570230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.570498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.571165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:52.571465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:52.572881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:52.589032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 105/225] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:52.594673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:52.598938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:52.604211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:52.604970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:52.605755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.606239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.606712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.607690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=750cb7c160ab471ca8eb856a77647087) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:52.608537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:52.611321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:52.620320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 121/226] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:52 2022] GET /identity/v3/role_assignments?user.id=750cb7c160ab471ca8eb856a77647087&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:52.714580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b42b-24d1-444e-9b89-049fbbd16f5a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:52.755799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:52.756977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.757454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.757919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] PATH_INFO: `/v3/users/dc513af15d87491990f538f6494c20ce` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.759563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] RBAC: Authorizing `identity:get_user(user_id=dc513af15d87491990f538f6494c20ce)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:52.761310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:52.763617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 106/227] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:52 2022] GET /identity/v3/users/dc513af15d87491990f538f6494c20ce => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:52.768939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:52.855700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:52.908446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30122517-5173-4d3f-baae-e95ce335a1cb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:52.944102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:52.961678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:52.962334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:52.962613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:52.962876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:52.967371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c591e-6c60-43fc-86d6-a43620e0d8ec None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:52.968282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:52.969760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:52.971795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 122/228] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:52 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:52.980406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:53.047104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:53.068410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:53.069240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:53.069528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:53.069806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:53.086674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fa7ef-26a4-4bd8-9013-39168ee5a41d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:53.100580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:53.105949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:53.106784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:53.107568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 107/229] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:25:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:25:53.124562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:53.125846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:53.126515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:53.126790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:53.127403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/dc513af15d87491990f538f6494c20ce/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:53.136446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] RBAC: Authorizing `identity:create_grant(project_id=f512fbc0185d45b58058cc54eeb6b126, user_id=dc513af15d87491990f538f6494c20ce, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:53.138200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:53.169408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 123/230] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:52 2022] PUT /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/dc513af15d87491990f538f6494c20ce/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:25:53.265065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f60da9-497d-42d7-9c39-8c3bf6ec0ba0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:53.315612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:53.315612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:53.315612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:53.315612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:53.316109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:53.316109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:53.316109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:53.316830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:53.332134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 108/231] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:25:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:53.338503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:53.461053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32338c-35c0-4765-804e-c067ef84345b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:53.487007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:53.498264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:53.499562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:53.499871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:53.500152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] PATH_INFO: `/v3/users/dc513af15d87491990f538f6494c20ce` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:53.501390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] RBAC: Authorizing `identity:get_user(user_id=dc513af15d87491990f538f6494c20ce)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:53.503185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:53.504973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 124/232] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:53 2022] GET /identity/v3/users/dc513af15d87491990f538f6494c20ce => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:53.510862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:53.617129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97904cf2-1596-4738-aa98-dfe45d0b05f8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:53.663983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f854bb5-fa19-4d96-b2f0-baec46678169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:53.665041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854bb5-fa19-4d96-b2f0-baec46678169 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:53.665517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854bb5-fa19-4d96-b2f0-baec46678169 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:53.665979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f854bb5-fa19-4d96-b2f0-baec46678169 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:53.671887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854bb5-fa19-4d96-b2f0-baec46678169 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:53.673625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f854bb5-fa19-4d96-b2f0-baec46678169 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:53.675636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 109/233] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:53 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:53.681920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:53.836008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30af26-9f53-47aa-ba20-c05f341ebdf9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:53.888794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369498ed-a81f-4d96-a709-c6006f185a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:53.889775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369498ed-a81f-4d96-a709-c6006f185a3e None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:53.890260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369498ed-a81f-4d96-a709-c6006f185a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:53.890706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369498ed-a81f-4d96-a709-c6006f185a3e None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/dc513af15d87491990f538f6494c20ce/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:53.893178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369498ed-a81f-4d96-a709-c6006f185a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=f512fbc0185d45b58058cc54eeb6b126, user_id=dc513af15d87491990f538f6494c20ce, role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:53.894853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369498ed-a81f-4d96-a709-c6006f185a3e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:53.927825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 125/234] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:53 2022] PUT /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/dc513af15d87491990f538f6494c20ce/roles/66545c4116b74dad93fef433e2619ef8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:25:54.245889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda81ab-f006-4ecf-a3df-2e98b943914c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:54.246377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda81ab-f006-4ecf-a3df-2e98b943914c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:54.246377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda81ab-f006-4ecf-a3df-2e98b943914c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:54.248006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 110/235] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:54.253532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a2f5-47f0-46ab-b4ad-1336e704e700 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:54.253962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a2f5-47f0-46ab-b4ad-1336e704e700 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:54.254119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a2f5-47f0-46ab-b4ad-1336e704e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:54.277458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b2e8a2f5-47f0-46ab-b4ad-1336e704e700 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:54.278662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b2e8a2f5-47f0-46ab-b4ad-1336e704e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:54.335528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017be9c7-46b2-4bc8-9f8d-7342df378f29 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:54.335853 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017be9c7-46b2-4bc8-9f8d-7342df378f29 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:54.336126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017be9c7-46b2-4bc8-9f8d-7342df378f29 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:54.337830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 111/236] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:54.343514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf9fd-0110-4e6a-87cf-6a5368ae4ec7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:54.343820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf9fd-0110-4e6a-87cf-6a5368ae4ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:54.344093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf9fd-0110-4e6a-87cf-6a5368ae4ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:54.356758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:54.366203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-34cbf9fd-0110-4e6a-87cf-6a5368ae4ec7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:54.367608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-34cbf9fd-0110-4e6a-87cf-6a5368ae4ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:54.402659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 126/237] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:54.455974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:54.470850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 112/238] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:54.779282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8a2f5-47f0-46ab-b4ad-1336e704e700 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:54.811015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a78d79-c5a2-4fa3-88d4-1c6423729bf2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:54.811343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a78d79-c5a2-4fa3-88d4-1c6423729bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:54.820390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a78d79-c5a2-4fa3-88d4-1c6423729bf2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:54.828033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 113/239] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:54 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:54.833054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b388c-0b77-43ba-9d69-e609af667ccc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:54.833338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b388c-0b77-43ba-9d69-e609af667ccc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:54.833651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b388c-0b77-43ba-9d69-e609af667ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:54.864057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a73b388c-0b77-43ba-9d69-e609af667ccc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:54.867637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a73b388c-0b77-43ba-9d69-e609af667ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:54.933660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8a2f5-47f0-46ab-b4ad-1336e704e700 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:54.975604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 114/240] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:54.975604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b388c-0b77-43ba-9d69-e609af667ccc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:54.989290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:54.990071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:54.990591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:54.990591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.010927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:55.017661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:55.018548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:55.019346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 127/241] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:55.028497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:55.115975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:55.158093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b388c-0b77-43ba-9d69-e609af667ccc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:55.203532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:55.214779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5984b0b-8fe0-4013-b1e8-2ffbf6d982f7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:55.217526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:55.218445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.218928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.219395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.220915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:55.222692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:55.224687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 115/242] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:55.230322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:55.280090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:55.282670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.284432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.284908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.285780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:55.287243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:55.290066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:55.312495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 128/243] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:55.325699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:55.392906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ae55b-07b2-4e1b-9dcb-93a438939105 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:55.430793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b42a2-efd7-4eef-a4f2-00d65f51c44c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:55.430988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:55.431531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.431843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.432117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.432779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:55.434528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:55.435562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:55.462198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 116/244] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:25:55 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:55.463622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:55.469098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:55.469959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.470350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.470709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] PATH_INFO: `/v3/users/80a22ed89f304186b74f23a6b7dfec24` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.486770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] RBAC: Authorizing `identity:get_user(user_id=80a22ed89f304186b74f23a6b7dfec24)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:55.488670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:55.495809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 129/245] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:55 2022] GET /identity/v3/users/80a22ed89f304186b74f23a6b7dfec24 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:55.497579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:55.526374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:55.590032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8826b-afe9-470e-897b-7cc9d8eca3ee None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:55.609568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f08820-8558-4861-9e9d-30da534849d3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:55.630151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d20cfe-b8f4-40ef-a8a2-d16efd0c8cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:55.631178 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d20cfe-b8f4-40ef-a8a2-d16efd0c8cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.631701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d20cfe-b8f4-40ef-a8a2-d16efd0c8cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.632148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d20cfe-b8f4-40ef-a8a2-d16efd0c8cf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.644643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d20cfe-b8f4-40ef-a8a2-d16efd0c8cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:55.649860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:55.650930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.651226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.651496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-08d20cfe-b8f4-40ef-a8a2-d16efd0c8cf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:55.651675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:55.652655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:55.653707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:55.656191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 117/246] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:55.657716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75eba-aec8-4c4b-8ea0-71d5bdcad0e7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.658178 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75eba-aec8-4c4b-8ea0-71d5bdcad0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.658620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75eba-aec8-4c4b-8ea0-71d5bdcad0e7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.660116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 118/247] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:55.663304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d75eba-aec8-4c4b-8ea0-71d5bdcad0e7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:55.694792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:55.753234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:55.755567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:55.810272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d75eba-aec8-4c4b-8ea0-71d5bdcad0e7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:55.821791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:55.855820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cad40a-1621-49c0-9a6f-bd5a0ffe0b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:55.857174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cad40a-1621-49c0-9a6f-bd5a0ffe0b67 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.857174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cad40a-1621-49c0-9a6f-bd5a0ffe0b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.857340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cad40a-1621-49c0-9a6f-bd5a0ffe0b67 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.857952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cad40a-1621-49c0-9a6f-bd5a0ffe0b67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:55.858257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cad40a-1621-49c0-9a6f-bd5a0ffe0b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:55.860270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cad40a-1621-49c0-9a6f-bd5a0ffe0b67 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:55.870873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 119/248] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:55.872239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471ae7-2394-4c7d-b8e6-bc8ad8cf551d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:55.872526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471ae7-2394-4c7d-b8e6-bc8ad8cf551d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:55.872810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471ae7-2394-4c7d-b8e6-bc8ad8cf551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:55.887679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 130/249] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:55.889375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:55.894163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cf471ae7-2394-4c7d-b8e6-bc8ad8cf551d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:55.896364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cf471ae7-2394-4c7d-b8e6-bc8ad8cf551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:55.964374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:55.983634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 120/250] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:55.984916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf471ae7-2394-4c7d-b8e6-bc8ad8cf551d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:56.013762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27ca01-99e2-4ccd-8256-e4b6413f3988 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:56.064940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:56.065804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.066306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.066787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] PATH_INFO: `/v3/users/750cb7c160ab471ca8eb856a77647087` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.070115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=750cb7c160ab471ca8eb856a77647087)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:56.071635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:56.073398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 131/251] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:55 2022] GET /identity/v3/users/750cb7c160ab471ca8eb856a77647087 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:56.096074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:56.099270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:56.106431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf471ae7-2394-4c7d-b8e6-bc8ad8cf551d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:56.159522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:56.160537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.161004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.161466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.164853 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:56.166582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:56.168705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 121/252] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:55 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:56.185685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:56.208787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38aec0-f398-4b6f-b700-fa83fdfd8ee3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:56.247624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:56.247624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.247624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.247624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.248053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:56.248053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:56.249169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 132/253] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:56 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:56.251894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:56.264600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:56.415895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8f711-b84a-490d-86f5-26e32bc82841 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:56.453219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104473f-98c6-4f80-8317-42fac9c69d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:56.453838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104473f-98c6-4f80-8317-42fac9c69d78 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.454115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104473f-98c6-4f80-8317-42fac9c69d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.454428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104473f-98c6-4f80-8317-42fac9c69d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.455161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104473f-98c6-4f80-8317-42fac9c69d78 None admin] RBAC: Adding query filter params (role.id=822b1d59d23e4939bfa9de27f135192a, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=80a22ed89f304186b74f23a6b7dfec24) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:56.455467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104473f-98c6-4f80-8317-42fac9c69d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:56.457266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104473f-98c6-4f80-8317-42fac9c69d78 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:56.463694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 122/254] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:56 2022] GET /identity/v3/role_assignments?user.id=80a22ed89f304186b74f23a6b7dfec24&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=822b1d59d23e4939bfa9de27f135192a => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:56.465148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d5d2-d81e-4b02-b94e-c1dc7c08839d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.465584 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d5d2-d81e-4b02-b94e-c1dc7c08839d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.465861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d5d2-d81e-4b02-b94e-c1dc7c08839d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.467500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 123/255] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:56.473861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4e8b-8c05-4c1d-ac0d-214c99798c67 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.474214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4e8b-8c05-4c1d-ac0d-214c99798c67 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.474447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4e8b-8c05-4c1d-ac0d-214c99798c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.489276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc37601-a8c9-45c7-9c22-1ad32024b5e3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:56.498160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-932c4e8b-8c05-4c1d-ac0d-214c99798c67 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:56.499392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-932c4e8b-8c05-4c1d-ac0d-214c99798c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:56.532260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:56.571259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:56.572216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.572498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.572776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/750cb7c160ab471ca8eb856a77647087/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.577044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] RBAC: Authorizing `identity:create_grant(project_id=f512fbc0185d45b58058cc54eeb6b126, user_id=750cb7c160ab471ca8eb856a77647087, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:56.578536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:56.609021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 133/256] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:25:56 2022] PUT /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/750cb7c160ab471ca8eb856a77647087/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:25:56.609749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:56.620967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 124/257] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:56.709730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:56.762968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b78ef-4726-43c7-ac24-e6f858a510df None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:56.808378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:56.809051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:56.809329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:56.809699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:56.823557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:56.828661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:56.829560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:56.830351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 134/258] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:56.836403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4e8b-8c05-4c1d-ac0d-214c99798c67 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:56.996239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4e8b-8c05-4c1d-ac0d-214c99798c67 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:57.034386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:57.035414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:57.035906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:57.036374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:57.037488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:57.038098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:57.039737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:57.051667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 125/259] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:57.058264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:57.115055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:57.156198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:57.257854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae444894-f4df-4b47-9975-cf86c954f9da None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:57.302745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:57.325364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:57.326465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:57.326919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:57.327367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] PATH_INFO: `/v3/users/dc513af15d87491990f538f6494c20ce` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:57.328743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] RBAC: Authorizing `identity:get_user(user_id=dc513af15d87491990f538f6494c20ce)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:57.330542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:57.340264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 135/260] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:57 2022] GET /identity/v3/users/dc513af15d87491990f538f6494c20ce => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:57.341457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:57.353119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c29e0-f06e-4b11-8b8c-e7bd0299060c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:57.467742 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:57.468449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:57.468674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:57.468945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:57.508201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:57.513862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:57.514799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:25:57.515621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 126/261] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:25:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:25:57.523380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:57.563988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1db61-b4e4-4082-b87c-2fe5ad7c80d6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:57.642696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:57.643328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:57.643622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:57.643897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:57.725758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:57.762301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:57.767378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b6c52-552e-45f3-a43b-de9fe7a53380 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:57.792358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:57.793859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:57.875603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:57.875603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:57.875603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:57.875603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:57.876016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:57.876016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:57.876016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:57.908957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 127/262] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:25:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:57.910412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:57.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 136/263] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:57.962447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:58.081142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:58.099230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9477a-5d07-4e6c-9540-669dabdc939f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:58.142424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:58.143444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.144025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.144487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.145883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:58.147848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:58.149854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 137/264] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:57 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:58.156804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:58.200348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa29323-dec9-411b-9f50-1adec33dccc7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:58.268113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:58.270287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.272012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.272484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] PATH_INFO: `/v3/users/dc513af15d87491990f538f6494c20ce` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.274719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] RBAC: Authorizing `identity:get_user(user_id=dc513af15d87491990f538f6494c20ce)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:58.277545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:58.280640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 128/265] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:57 2022] GET /identity/v3/users/dc513af15d87491990f538f6494c20ce => generated 283 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:58.286434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:58.320251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:58.346624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b30466-0499-4f0c-9847-165ec9f467ba None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:58.383078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03938a10-b1cb-400b-9483-3ee1f00da508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:58.383733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03938a10-b1cb-400b-9483-3ee1f00da508 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.384018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03938a10-b1cb-400b-9483-3ee1f00da508 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.384288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03938a10-b1cb-400b-9483-3ee1f00da508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.385026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03938a10-b1cb-400b-9483-3ee1f00da508 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=dc513af15d87491990f538f6494c20ce) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:58.385329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03938a10-b1cb-400b-9483-3ee1f00da508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:58.386797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03938a10-b1cb-400b-9483-3ee1f00da508 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:58.393698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 138/266] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:58 2022] GET /identity/v3/role_assignments?user.id=dc513af15d87491990f538f6494c20ce&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:25:58.456907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ec45-829c-49b0-82e4-faf429a2249e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.457278 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ec45-829c-49b0-82e4-faf429a2249e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.457459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ec45-829c-49b0-82e4-faf429a2249e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.459085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 139/267] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:58.472971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bff0e-2da9-45c5-9c68-76c90ef75bec None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.473281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bff0e-2da9-45c5-9c68-76c90ef75bec None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.473521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bff0e-2da9-45c5-9c68-76c90ef75bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.512879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-034bff0e-2da9-45c5-9c68-76c90ef75bec None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:58.514160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-034bff0e-2da9-45c5-9c68-76c90ef75bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:58.519962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fad48c-aa7e-4d7a-9b6f-54c109d888db None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:58.539156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:58.625033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34054fd4-f552-4d98-a1d5-40e9410b444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:58.625609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 140/268] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:58.626076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34054fd4-f552-4d98-a1d5-40e9410b444a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.631726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34054fd4-f552-4d98-a1d5-40e9410b444a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.631726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34054fd4-f552-4d98-a1d5-40e9410b444a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.652330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb5bbd-3eec-481c-b9d4-df2f6a626b7e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.652890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb5bbd-3eec-481c-b9d4-df2f6a626b7e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.653311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb5bbd-3eec-481c-b9d4-df2f6a626b7e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.657487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 141/269] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:58.660774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ed1b-25ba-4df4-ac39-dc3d24064742 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.661970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ed1b-25ba-4df4-ac39-dc3d24064742 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.662430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9ed1b-25ba-4df4-ac39-dc3d24064742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.690789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-99a9ed1b-25ba-4df4-ac39-dc3d24064742 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:58.692307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-99a9ed1b-25ba-4df4-ac39-dc3d24064742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:58.734414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34054fd4-f552-4d98-a1d5-40e9410b444a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:58.736062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34054fd4-f552-4d98-a1d5-40e9410b444a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:58.755500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:58.823306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 142/270] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:58.841735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 129/271] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:25:58.847705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ed1b-25ba-4df4-ac39-dc3d24064742 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:58.951234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:58.967928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c949447-fdd1-4b39-ae78-b71a032c1962 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.968261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c949447-fdd1-4b39-ae78-b71a032c1962 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.968532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c949447-fdd1-4b39-ae78-b71a032c1962 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:58.970083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 130/272] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:25:58.973423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9ed1b-25ba-4df4-ac39-dc3d24064742 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:58.976992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae25bf6-1838-4319-a9e6-972ab54733bc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:58.977274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae25bf6-1838-4319-a9e6-972ab54733bc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:58.977542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae25bf6-1838-4319-a9e6-972ab54733bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.001143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9ae25bf6-1838-4319-a9e6-972ab54733bc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:59.002893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9ae25bf6-1838-4319-a9e6-972ab54733bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:59.031643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.032676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.033828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.034432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.037975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:59.039603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:59.042493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 143/273] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:25:58 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:59.044633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.106963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 131/274] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:25:59.108116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae25bf6-1838-4319-a9e6-972ab54733bc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.155568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:59.179753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07428514-e807-430e-a696-92510f0a2e65 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.214147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.215119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.215612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.216067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.222720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae25bf6-1838-4319-a9e6-972ab54733bc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.227133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:59.232267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:59.233123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:25:59.233898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:59.236503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 144/275] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:59.237525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.270648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.271411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.271740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.272118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.272876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] RBAC: Adding query filter params (role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=dc513af15d87491990f538f6494c20ce) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:59.273170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:59.274881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:59.275924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:59.282733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 132/276] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/role_assignments?user.id=dc513af15d87491990f538f6494c20ce&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=66545c4116b74dad93fef433e2619ef8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:59.283805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.428187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f193d-8ced-493e-b86a-4121d3139bad None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.454985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3f05f-cf12-4d3b-9a51-8b0e0c0b8872 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.467679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:59.471111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.472256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.472358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.472631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.473693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:59.475468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:59.479890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 145/277] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:59.479890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.504095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.504452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.504626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.504888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.505647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:59.505911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:59.507303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:59.517956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 133/278] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:59.519085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.574564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:59.604369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c3f9-056d-4377-8451-fe4d79981a9c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.633897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8f643-2a79-4853-b5ab-f062ba2f1cd2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.640203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.640806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.641094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.641351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.652126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:25:59.657020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:25:59.658079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 146/279] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:25:59.658972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.670695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c2637-a609-4627-b998-09f7531c84dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.671712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2637-a609-4627-b998-09f7531c84dc None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.672000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2637-a609-4627-b998-09f7531c84dc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.672280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c2637-a609-4627-b998-09f7531c84dc None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.673254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c2637-a609-4627-b998-09f7531c84dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:59.674727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c2637-a609-4627-b998-09f7531c84dc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:59.696589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 134/280] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:25:59 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:25:59.697824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6231d-ca3a-46c1-8b4e-c61eb8ef494f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.698111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6231d-ca3a-46c1-8b4e-c61eb8ef494f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.698382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6231d-ca3a-46c1-8b4e-c61eb8ef494f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.699604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 135/281] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:25:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:25:59.700315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6231d-ca3a-46c1-8b4e-c61eb8ef494f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.733480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:59.788025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175797-f075-4523-9c28-1fdf10f81737 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.824532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6231d-ca3a-46c1-8b4e-c61eb8ef494f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:25:59.826195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d46c81-232d-4e36-866b-98a4721af4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.826702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46c81-232d-4e36-866b-98a4721af4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.826980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46c81-232d-4e36-866b-98a4721af4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.827252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d46c81-232d-4e36-866b-98a4721af4e4 None admin] PATH_INFO: `/v3/users/932a3338793d411da58b349e970a94a0` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.829644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:25:59.844679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d46c81-232d-4e36-866b-98a4721af4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=932a3338793d411da58b349e970a94a0)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:59.845690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d46c81-232d-4e36-866b-98a4721af4e4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:59.847384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 147/282] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/users/932a3338793d411da58b349e970a94a0 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:59.848590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2193-1601-4d5e-9faa-e3337a7ad5f3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.848872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2193-1601-4d5e-9faa-e3337a7ad5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.849211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2193-1601-4d5e-9faa-e3337a7ad5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.870401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:25:59.870873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6f4b2193-1601-4d5e-9faa-e3337a7ad5f3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:25:59.871046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:25:59.871305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:25:59.871570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:25:59.872281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:25:59.872380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6f4b2193-1601-4d5e-9faa-e3337a7ad5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:25:59.872581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:25:59.873966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:25:59.884638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 136/283] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:25:59.884638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:25:59.956345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 148/284] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:25:59.957229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b2193-1601-4d5e-9faa-e3337a7ad5f3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:00.002726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:00.022440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a088b1-7c9a-457f-856e-fc2c483bd7f8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:00.066307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:00.066928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:00.067205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:00.067476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:00.068585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, user.id=932a3338793d411da58b349e970a94a0, scope.system=all) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:00.069322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:00.070775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:00.077883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 137/285] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/role_assignments?user.id=932a3338793d411da58b349e970a94a0&scope.system=all&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:00.084556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b2193-1601-4d5e-9faa-e3337a7ad5f3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:00.112811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:00.127757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:00.129246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:00.129990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:00.130560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] PATH_INFO: `/v3/users/80a22ed89f304186b74f23a6b7dfec24` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:00.132811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=80a22ed89f304186b74f23a6b7dfec24)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:00.134617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:00.136927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 149/286] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:25:59 2022] GET /identity/v3/users/80a22ed89f304186b74f23a6b7dfec24 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:00.143152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:00.251914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:00.265508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000587ae-a70a-439d-b208-69655cfb7f5d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:00.299965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:00.300616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:00.300892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:00.301164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:00.302435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:00.304162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:00.306284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 138/287] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:00 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:00.321075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:00.363075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:00.420854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d10af-0037-4e90-a3a8-0b6b3c04a3e7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:00.478646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:00.479745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:00.480229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:00.480669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:00.497041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:00.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:00.506924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:00.507763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:00.514080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 150/288] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:00.518344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:00.535393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8f0f-e37c-420c-916d-3ed658387e68 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:00.598927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:00.602129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:00.603002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:00.603460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:00.603899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/80a22ed89f304186b74f23a6b7dfec24/roles/822b1d59d23e4939bfa9de27f135192a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:00.605987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f512fbc0185d45b58058cc54eeb6b126, user_id=80a22ed89f304186b74f23a6b7dfec24, role_id=822b1d59d23e4939bfa9de27f135192a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:00.607836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:00.625675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 139/289] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:26:00 2022] PUT /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126/users/80a22ed89f304186b74f23a6b7dfec24/roles/822b1d59d23e4939bfa9de27f135192a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:00.682572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bea2d-a3af-4eba-8e8f-8f0f9ecab807 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:00.731134 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:00.731782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:00.732069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:00.732332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:00.733008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:00.733303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:00.734686 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:00.744986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 151/290] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:00.750496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:00.898017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:00.920223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0ab5-7880-4a00-8cec-cf276d557ea3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:00.968640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:00.969284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:00.969561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:00.969827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] PATH_INFO: `/v3/users/750cb7c160ab471ca8eb856a77647087` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:00.976412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] RBAC: Authorizing `identity:get_user(user_id=750cb7c160ab471ca8eb856a77647087)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:00.977902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:00.979923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 140/291] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:26:00 2022] GET /identity/v3/users/750cb7c160ab471ca8eb856a77647087 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:00.985910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:01.106548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e78469-4bc6-487b-a6ed-66a84f5b90cb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:01.119911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:01.147035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:01.147686 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:01.147970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:01.148287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:01.220850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:01.222318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:01.328170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 152/292] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:01.333897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:01.476252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930580d-b7c8-48aa-9182-9e23fb612e49 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:01.522627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b75ff-d0a9-4e57-8868-b5b4325389a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:01.523273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b75ff-d0a9-4e57-8868-b5b4325389a9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:01.523548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b75ff-d0a9-4e57-8868-b5b4325389a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:01.523843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b75ff-d0a9-4e57-8868-b5b4325389a9 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:01.524958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b75ff-d0a9-4e57-8868-b5b4325389a9 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:01.526420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b75ff-d0a9-4e57-8868-b5b4325389a9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:01.528404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 141/293] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:01 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:01.534329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:01.553368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:01.641388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236577-4251-40b9-93ce-90b94d43012e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:01.677141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15e93f-82f8-449e-981e-3cc720fa6d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:01.678171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15e93f-82f8-449e-981e-3cc720fa6d06 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:01.678444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15e93f-82f8-449e-981e-3cc720fa6d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:01.678705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15e93f-82f8-449e-981e-3cc720fa6d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:01.679438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15e93f-82f8-449e-981e-3cc720fa6d06 None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=750cb7c160ab471ca8eb856a77647087) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:01.679771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15e93f-82f8-449e-981e-3cc720fa6d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:01.681218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15e93f-82f8-449e-981e-3cc720fa6d06 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:01.687759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 153/294] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:01 2022] GET /identity/v3/role_assignments?user.id=750cb7c160ab471ca8eb856a77647087&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:01.992493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badd59d-8e5e-402a-829d-d274293636e6 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:01.993046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badd59d-8e5e-402a-829d-d274293636e6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:01.993046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badd59d-8e5e-402a-829d-d274293636e6 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:01.994646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 142/295] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:02.000132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496cd6b-cd19-4b46-adee-1f099b630bcd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.000538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496cd6b-cd19-4b46-adee-1f099b630bcd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.000909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496cd6b-cd19-4b46-adee-1f099b630bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.021296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2496cd6b-cd19-4b46-adee-1f099b630bcd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:02.022682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2496cd6b-cd19-4b46-adee-1f099b630bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:02.097954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 154/296] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:02.310630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304dea-8068-4b0c-aade-810cfef58bba None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.310923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304dea-8068-4b0c-aade-810cfef58bba None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.311189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304dea-8068-4b0c-aade-810cfef58bba None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.312836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 143/297] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:02.318693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceda099-54c8-4ca8-811e-7427671c3b35 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.319032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceda099-54c8-4ca8-811e-7427671c3b35 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.319276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceda099-54c8-4ca8-811e-7427671c3b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.331744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:02.337761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2ceda099-54c8-4ca8-811e-7427671c3b35 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:02.339016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2ceda099-54c8-4ca8-811e-7427671c3b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:02.406764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55304dea-8068-4b0c-aade-810cfef58bba None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:02.415615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 155/298] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:02.415615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063e0c-5234-4bc1-a022-25306801fde4 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.415615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063e0c-5234-4bc1-a022-25306801fde4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.415615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c063e0c-5234-4bc1-a022-25306801fde4 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.416605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 156/299] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:02.421788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2d97-4a1d-4dda-813c-3d9a2e9e42be None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.422068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2d97-4a1d-4dda-813c-3d9a2e9e42be None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.422338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2d97-4a1d-4dda-813c-3d9a2e9e42be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.430846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:02.443851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4f4f2d97-4a1d-4dda-813c-3d9a2e9e42be None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:02.445151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4f4f2d97-4a1d-4dda-813c-3d9a2e9e42be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:02.518313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55304dea-8068-4b0c-aade-810cfef58bba None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:02.533957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 157/300] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:02.558586 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:02.559270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.559549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.559985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.570752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:02.576122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:02.578059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:02.579035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 144/301] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:02.586066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2d97-4a1d-4dda-813c-3d9a2e9e42be None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:02.654040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:02.697177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2d97-4a1d-4dda-813c-3d9a2e9e42be None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:02.702268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:02.739522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:02.741105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.741396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.741674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.742654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:02.742962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:02.744387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:02.754902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 158/302] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:02.760718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:02.805982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:02.836483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b99d4a-258b-4994-b049-a4d5ac475f4e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:02.874462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:02.875399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.875842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.876112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.886510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3169b1-2f26-422a-a148-938d113be5b0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:02.887183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:02.892846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:02.893781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 145/303] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:02.897272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:02.924038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:02.933748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:02.934391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:02.934672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:02.934950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] PATH_INFO: `/v3/users/668cf2d232624bf984ab4f72c0c47738` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:02.951061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] RBAC: Authorizing `identity:get_user(user_id=668cf2d232624bf984ab4f72c0c47738)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:02.952563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:02.954230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 159/304] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:26:02 2022] GET /identity/v3/users/668cf2d232624bf984ab4f72c0c47738 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:02.954992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:03.019017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fde2e-b587-4548-aa80-5b273c818459 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:03.052862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:03.053668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.053947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.054215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.055309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:03.056791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:03.058376 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 146/305] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:03.063721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:03.064809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ede3e-36b9-4285-9bba-91ef276cc60b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:03.068856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:03.102912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:03.103438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.103788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.104062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.104966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:03.105073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:03.106402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:03.114972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 160/306] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:03.116445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:03.170233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:03.174286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873864a2-808f-4788-ab0e-8a2d0e1bad83 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:03.212292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:03.212927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.213210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.213485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.214216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] RBAC: Adding query filter params (role.id=822b1d59d23e4939bfa9de27f135192a, user.id=668cf2d232624bf984ab4f72c0c47738, scope.system=all) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:03.214524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:03.216727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:03.223111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 147/307] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 16:26:03 2022] GET /identity/v3/role_assignments?user.id=668cf2d232624bf984ab4f72c0c47738&scope.system=all&role.id=822b1d59d23e4939bfa9de27f135192a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:03.223948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:03.236287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b28bc6-87f1-4c74-954b-618b537cca06 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:03.280491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee1452-bd37-4831-abe8-77b666d5240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:03.281142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1452-bd37-4831-abe8-77b666d5240a None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.281418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1452-bd37-4831-abe8-77b666d5240a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.281688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1452-bd37-4831-abe8-77b666d5240a None admin] PATH_INFO: `/v3/groups` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.282335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee1452-bd37-4831-abe8-77b666d5240a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:03.284018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee1452-bd37-4831-abe8-77b666d5240a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:03.316694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 161/308] 10.222.0.88 () {60 vars in 1134 bytes} [Wed Aug 24 16:26:03 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:03.318690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75b05-6e5e-4972-aa40-60770f693f6a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.319825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:03.319997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75b05-6e5e-4972-aa40-60770f693f6a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.320265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75b05-6e5e-4972-aa40-60770f693f6a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.326530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 162/309] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:03.328541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b21f-2f7e-47a1-936c-4946fc5b5a80 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.328823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b21f-2f7e-47a1-936c-4946fc5b5a80 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.329090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9b21f-2f7e-47a1-936c-4946fc5b5a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.350700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-76f9b21f-2f7e-47a1-936c-4946fc5b5a80 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:03.352103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-76f9b21f-2f7e-47a1-936c-4946fc5b5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:03.372850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea3ae4-e188-4c97-91bb-9f6f067dbf44 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:03.416594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:03.417629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.418112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.418558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] PATH_INFO: `/v3/users/932a3338793d411da58b349e970a94a0` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.420061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] RBAC: Authorizing `identity:get_user(user_id=932a3338793d411da58b349e970a94a0)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:03.421761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:03.423714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 148/310] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:26:03 2022] GET /identity/v3/users/932a3338793d411da58b349e970a94a0 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:03.429753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:03.451616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 163/311] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:03.543544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2eae44-5126-48ac-939d-9d5604ac6e8e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:03.579326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:03.580011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.580287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.580556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] PATH_INFO: `/v3/system/users/932a3338793d411da58b349e970a94a0/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.582000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=932a3338793d411da58b349e970a94a0, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:03.583394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:03.587072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:03.595872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 149/312] 10.222.0.88 () {58 vars in 1334 bytes} [Wed Aug 24 16:26:03 2022] PUT /identity/v3/system/users/932a3338793d411da58b349e970a94a0/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:03.721223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9b21f-2f7e-47a1-936c-4946fc5b5a80 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:03.769747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:03.834190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9b21f-2f7e-47a1-936c-4946fc5b5a80 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:03.868200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:03.868839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:03.869116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:03.869383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:03.880291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:03.885163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:03.886058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:03.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 164/313] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:03.894104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:04.000046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b173-3575-437d-b5db-629f83faadad None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:04.035167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:04.035939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:04.036112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:04.036331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:04.037074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:04.037374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:04.038754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:04.047921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 150/314] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:04.053760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:04.156194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:04.159808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511d82e-49eb-427f-8cc2-d2c73560c2bd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:04.196955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:04.197589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:04.197861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:04.198129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] PATH_INFO: `/v3/users/80a22ed89f304186b74f23a6b7dfec24` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:04.199244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] RBAC: Authorizing `identity:get_user(user_id=80a22ed89f304186b74f23a6b7dfec24)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:04.200938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:04.202587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 165/315] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:26:04 2022] GET /identity/v3/users/80a22ed89f304186b74f23a6b7dfec24 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:04.208297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:04.272223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:04.318623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4da2a8-9055-442a-91b8-82e2485d9593 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:04.353683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:04.354396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:04.354681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:04.354952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:04.430058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:04.431529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:04.493046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:04.540196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 151/316] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:04.545393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:04.654579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb0942-596f-4a07-80cb-981660e0fa38 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:04.690025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ba5d9-e95d-4706-982c-eea8a9a5d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:04.690662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba5d9-e95d-4706-982c-eea8a9a5d818 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:04.690936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba5d9-e95d-4706-982c-eea8a9a5d818 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:04.691215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ba5d9-e95d-4706-982c-eea8a9a5d818 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:04.692424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ba5d9-e95d-4706-982c-eea8a9a5d818 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:04.694116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ba5d9-e95d-4706-982c-eea8a9a5d818 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:04.696087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 166/317] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:04 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:04.701948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:04.802903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add5bd1-242e-4617-ba3c-ea5fdea703ab None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:04.836947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ef010-249f-407e-85dc-70ea266ab409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:04.837612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ef010-249f-407e-85dc-70ea266ab409 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:04.837892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ef010-249f-407e-85dc-70ea266ab409 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:04.838164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ef010-249f-407e-85dc-70ea266ab409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:04.838888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ef010-249f-407e-85dc-70ea266ab409 None admin] RBAC: Adding query filter params (role.id=822b1d59d23e4939bfa9de27f135192a, scope.project.id=f512fbc0185d45b58058cc54eeb6b126, user.id=80a22ed89f304186b74f23a6b7dfec24) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:04.839189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ef010-249f-407e-85dc-70ea266ab409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:04.840669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ef010-249f-407e-85dc-70ea266ab409 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:04.846897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 152/318] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:04 2022] GET /identity/v3/role_assignments?user.id=80a22ed89f304186b74f23a6b7dfec24&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=822b1d59d23e4939bfa9de27f135192a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:05.219193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ff97-4eee-4cb5-831c-8414852e0fa8 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.219719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ff97-4eee-4cb5-831c-8414852e0fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.219719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106ff97-4eee-4cb5-831c-8414852e0fa8 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.221170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 167/319] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:05.226540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835fd5d-6086-4588-b260-84850ef3d2bf None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.226963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835fd5d-6086-4588-b260-84850ef3d2bf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.227103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835fd5d-6086-4588-b260-84850ef3d2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.245905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b835fd5d-6086-4588-b260-84850ef3d2bf None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:05.247106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b835fd5d-6086-4588-b260-84850ef3d2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:05.269417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:05.329001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 153/320] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:05.434559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09175530-b35f-47ed-b982-128c2a9d6a91 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.434800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09175530-b35f-47ed-b982-128c2a9d6a91 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.435204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09175530-b35f-47ed-b982-128c2a9d6a91 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.436871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 168/321] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:05.442034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23cf2-73bb-4393-bee7-2e548ca23483 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.442323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23cf2-73bb-4393-bee7-2e548ca23483 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.442596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff23cf2-73bb-4393-bee7-2e548ca23483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.462624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6ff23cf2-73bb-4393-bee7-2e548ca23483 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:05.463873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6ff23cf2-73bb-4393-bee7-2e548ca23483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:05.537929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 154/322] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:05.591395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991adf8-f711-4c85-a89c-d40a8fe69278 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.591738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991adf8-f711-4c85-a89c-d40a8fe69278 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.591983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991adf8-f711-4c85-a89c-d40a8fe69278 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.593544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 169/323] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:05.594842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff23cf2-73bb-4393-bee7-2e548ca23483 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:05.598209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29982-5dae-47c6-86c9-cca6e9946ff8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.598494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29982-5dae-47c6-86c9-cca6e9946ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.598765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade29982-5dae-47c6-86c9-cca6e9946ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.617200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ade29982-5dae-47c6-86c9-cca6e9946ff8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:05.618293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ade29982-5dae-47c6-86c9-cca6e9946ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:05.649791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:05.691001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:05.695706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 170/324] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:05.707005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff23cf2-73bb-4393-bee7-2e548ca23483 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:05.741659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:05.742518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.742939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.743352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.754509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:05.759620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:05.760564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:05.761365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:05.763715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 155/325] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:05.767215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29982-5dae-47c6-86c9-cca6e9946ff8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:05.810102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:05.875470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade29982-5dae-47c6-86c9-cca6e9946ff8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:05.915747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:05.916371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.916650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.916743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4adde-6ea4-459f-b653-48f0b5dfe36a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:05.916920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.917578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:05.917888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:05.919667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:05.932468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 171/326] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:05.933541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:05.959084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:05.959753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:05.960033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:05.960307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:05.961416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:05.962889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:05.964506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 156/327] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:05.964693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:05.965260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:05.980967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:06.042555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66703983-f3f3-45e2-9034-23930309cbc3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:06.068373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312cad2-1e63-417e-a9a0-813fe54dc129 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:06.076549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:06.077182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:06.077454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:06.077720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] PATH_INFO: `/v3/users/668cf2d232624bf984ab4f72c0c47738` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:06.078834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] RBAC: Authorizing `identity:get_user(user_id=668cf2d232624bf984ab4f72c0c47738)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:06.080304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:06.081890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 172/328] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:26:05 2022] GET /identity/v3/users/668cf2d232624bf984ab4f72c0c47738 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:06.082691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:06.104812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:06.105449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:06.105729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:06.106000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:06.116368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:06.121536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:06.122533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 157/329] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:06.124317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:06.179125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:06.186696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedcdc3-a899-4514-90dc-b10b3cba39fe None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:06.199916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:06.220967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:06.221583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:06.221862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:06.222137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] PATH_INFO: `/v3/groups` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:06.222759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:06.224416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:06.226706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3a9b8-7d9b-4266-93c9-c3c88a0ee324 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:06.241673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 173/330] 10.222.0.88 () {60 vars in 1134 bytes} [Wed Aug 24 16:26:06 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:06.242494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:06.265692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:06.266547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:06.266828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:06.267156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] PATH_INFO: `/v3/system/users/668cf2d232624bf984ab4f72c0c47738/roles/822b1d59d23e4939bfa9de27f135192a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:06.268863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=668cf2d232624bf984ab4f72c0c47738, role_id=822b1d59d23e4939bfa9de27f135192a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:06.270302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:06.280124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 158/331] 10.222.0.88 () {58 vars in 1334 bytes} [Wed Aug 24 16:26:06 2022] PUT /identity/v3/system/users/668cf2d232624bf984ab4f72c0c47738/roles/822b1d59d23e4939bfa9de27f135192a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:06.390652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c33479-0d7c-47cb-8f81-e4d5f0478946 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:06.433054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:06.433694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:06.433970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:06.434234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:06.434974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:06.435275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:06.436822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:06.446862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 174/332] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:06.453156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:06.561309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4512b46-199a-40aa-8226-0a962cfb0648 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:06.602381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed219426-0e37-4bef-81c3-bc26d9468c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:06.603035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed219426-0e37-4bef-81c3-bc26d9468c7b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:06.603317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed219426-0e37-4bef-81c3-bc26d9468c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:06.603613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed219426-0e37-4bef-81c3-bc26d9468c7b None admin] PATH_INFO: `/v3/users/932a3338793d411da58b349e970a94a0` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:06.604785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed219426-0e37-4bef-81c3-bc26d9468c7b None admin] RBAC: Authorizing `identity:get_user(user_id=932a3338793d411da58b349e970a94a0)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:06.606252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed219426-0e37-4bef-81c3-bc26d9468c7b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:06.608267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 159/333] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:26:06 2022] GET /identity/v3/users/932a3338793d411da58b349e970a94a0 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:06.614205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:06.635170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:06.733313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ba52-fb4a-4070-b2bf-7497b414b2a2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:06.771030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35282a-0ab3-44ec-8a51-a892b2a381a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:06.772120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35282a-0ab3-44ec-8a51-a892b2a381a1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:06.772553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35282a-0ab3-44ec-8a51-a892b2a381a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:06.773072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35282a-0ab3-44ec-8a51-a892b2a381a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:06.773826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35282a-0ab3-44ec-8a51-a892b2a381a1 None admin] RBAC: Adding query filter params (role.id=f264736e364b458eb3ef7842c6f5c982, user.id=932a3338793d411da58b349e970a94a0, scope.system=all) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:06.774135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35282a-0ab3-44ec-8a51-a892b2a381a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:06.775769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35282a-0ab3-44ec-8a51-a892b2a381a1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:06.792309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 175/334] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 16:26:06 2022] GET /identity/v3/role_assignments?user.id=932a3338793d411da58b349e970a94a0&scope.system=all&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:08.445201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3f34-2d9d-4daf-89af-504230425b1c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:08.445753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3f34-2d9d-4daf-89af-504230425b1c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:08.445753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e3f34-2d9d-4daf-89af-504230425b1c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:08.447351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 160/335] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:08.452993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c621-a0a3-4452-b943-a232d848603a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:08.453399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c621-a0a3-4452-b943-a232d848603a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:08.453531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c621-a0a3-4452-b943-a232d848603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:08.474187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9082c621-a0a3-4452-b943-a232d848603a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:08.475431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9082c621-a0a3-4452-b943-a232d848603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:08.562973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 176/336] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:08.574258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e8efc-8773-44be-a161-f35477b9b9b5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:08.574538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e8efc-8773-44be-a161-f35477b9b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:08.574811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e8efc-8773-44be-a161-f35477b9b9b5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:08.578640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 161/337] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:08.583170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa294089-cb56-44a3-997b-94a3d6ea2d72 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:08.583457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa294089-cb56-44a3-997b-94a3d6ea2d72 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:08.583824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa294089-cb56-44a3-997b-94a3d6ea2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:08.594267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:08.611834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-aa294089-cb56-44a3-997b-94a3d6ea2d72 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:08.613032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-aa294089-cb56-44a3-997b-94a3d6ea2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:08.706180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 177/338] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:08.864538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda0a9-979c-4625-85f5-7101016f8020 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:08.864729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda0a9-979c-4625-85f5-7101016f8020 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:08.865039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda0a9-979c-4625-85f5-7101016f8020 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:08.866530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 162/339] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:08.872362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf633aa-945b-484b-8bdf-9e04190aa815 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:08.872650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf633aa-945b-484b-8bdf-9e04190aa815 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:08.872923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf633aa-945b-484b-8bdf-9e04190aa815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:08.896977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5cf633aa-945b-484b-8bdf-9e04190aa815 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:08.898181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5cf633aa-945b-484b-8bdf-9e04190aa815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:08.942488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eda0a9-979c-4625-85f5-7101016f8020 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:08.953530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:09.025805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 178/340] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:09.116985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eda0a9-979c-4625-85f5-7101016f8020 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:09.137012 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf633aa-945b-484b-8bdf-9e04190aa815 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:09.163995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:09.164655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.164937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.165212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.182230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:09.195097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:09.196055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:09.196840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 163/341] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:09.204456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:09.247108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:09.318478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:09.361590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf633aa-945b-484b-8bdf-9e04190aa815 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:09.366347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf81c0-2bc8-48b4-b3a5-f76d5292be15 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:09.416687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:09.417532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.417953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.418363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.419183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:09.419687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:09.421214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:09.442333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 164/342] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:09.446133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:09.465353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:09.466753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.467537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.468097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.487179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:09.501329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:09.502836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:09.503871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:09.506829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 179/343] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:09.508311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:09.648136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ecf60-e468-4ea6-9320-4e66c4bb2474 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:09.682476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:09.705258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:09.705902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.706233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.706543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] PATH_INFO: `/v3/users/668cf2d232624bf984ab4f72c0c47738` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.707742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] RBAC: Authorizing `identity:get_user(user_id=668cf2d232624bf984ab4f72c0c47738)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:09.709430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:09.711326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d783bcf-04f7-40d7-a3e3-d0a6943ace6c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:09.711448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 180/344] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:26:09 2022] GET /identity/v3/users/668cf2d232624bf984ab4f72c0c47738 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:09.712000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:09.750285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:09.761050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259e04e-401f-44a8-9ee3-e06d810f8c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:09.761696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e04e-401f-44a8-9ee3-e06d810f8c2e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.761978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e04e-401f-44a8-9ee3-e06d810f8c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.762253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e04e-401f-44a8-9ee3-e06d810f8c2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.775255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259e04e-401f-44a8-9ee3-e06d810f8c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0259e04e-401f-44a8-9ee3-e06d810f8c2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:09.782182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:09.783266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:09.784148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:09.791895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 165/345] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:26:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:09.793663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b15d7-65ab-47f2-9f6c-a78ad673525a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.793950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b15d7-65ab-47f2-9f6c-a78ad673525a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.794227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b15d7-65ab-47f2-9f6c-a78ad673525a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.795846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 166/346] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:09.796264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b15d7-65ab-47f2-9f6c-a78ad673525a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:09.855814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cb940-ddec-4b2e-b2fb-a08abac238cd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:09.899807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:09.900432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.900711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.900983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.901792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:09.901974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:09.903332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:09.917351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 181/347] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:09.917351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:09.941140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b15d7-65ab-47f2-9f6c-a78ad673525a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:09.993284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:09.995774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4362010-c43b-4175-936b-6c53667f1bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:09.996398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362010-c43b-4175-936b-6c53667f1bfa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:09.996689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362010-c43b-4175-936b-6c53667f1bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:09.996936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362010-c43b-4175-936b-6c53667f1bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:09.997855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4362010-c43b-4175-936b-6c53667f1bfa None admin] RBAC: Adding query filter params (role.id=822b1d59d23e4939bfa9de27f135192a, user.id=668cf2d232624bf984ab4f72c0c47738, scope.system=all) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:09.998637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4362010-c43b-4175-936b-6c53667f1bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:10.003723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4362010-c43b-4175-936b-6c53667f1bfa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:10.020993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 167/348] 10.222.0.88 () {56 vars in 1308 bytes} [Wed Aug 24 16:26:09 2022] GET /identity/v3/role_assignments?user.id=668cf2d232624bf984ab4f72c0c47738&scope.system=all&role.id=822b1d59d23e4939bfa9de27f135192a => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:10.022187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6097ed-6a99-4b0f-aa15-44a6205046e7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:10.022472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6097ed-6a99-4b0f-aa15-44a6205046e7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:10.022745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6097ed-6a99-4b0f-aa15-44a6205046e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:10.042218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7a6097ed-6a99-4b0f-aa15-44a6205046e7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:10.043425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7a6097ed-6a99-4b0f-aa15-44a6205046e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:10.056002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443ef8f-0033-414e-9050-746c292425f0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:10.119357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:10.120037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:10.120319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:10.120598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:10.121291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:10.121595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:10.123041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:10.147695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 182/349] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:10.148578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:10.149409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:10.206735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 168/350] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:10.207641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6097ed-6a99-4b0f-aa15-44a6205046e7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:10.344199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531acc3-cb6d-4bd4-af50-646ca0de3a81 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:10.366001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6097ed-6a99-4b0f-aa15-44a6205046e7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:10.376684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:10.408802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:10.409428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:10.409706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:10.409975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:10.430247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:10.430877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:10.431158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:10.431430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:10.523663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:10.524271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:10.525587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:10.564822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:10.566307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:10.681347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 183/351] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:10.682312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:10.697969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 169/352] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:10.698830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:10.706439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:10.788560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:10.815819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f656a-fa40-4ef1-8bd2-e664aa0ee50a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:10.816371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ba6fa-b68b-4e4d-ba91-990d81f0ab94 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:10.857917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44759d8d-4d03-4fa1-b40a-34b1850a87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:10.858565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44759d8d-4d03-4fa1-b40a-34b1850a87b2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:10.858847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44759d8d-4d03-4fa1-b40a-34b1850a87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:10.858942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:10.859109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44759d8d-4d03-4fa1-b40a-34b1850a87b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:10.859570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:10.859884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:10.860155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:10.861691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:10.863221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:10.865171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 170/353] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:10 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:10.866264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:10.874221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44759d8d-4d03-4fa1-b40a-34b1850a87b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-44759d8d-4d03-4fa1-b40a-34b1850a87b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:10.880576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:10.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:10.882337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:10.884847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 184/354] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:10.885917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c222-6eff-4822-b361-3929593deab1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:10.886199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c222-6eff-4822-b361-3929593deab1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:10.886469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2c222-6eff-4822-b361-3929593deab1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:10.887956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 185/355] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:10.888559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c222-6eff-4822-b361-3929593deab1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:10.994018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.016452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eaaf0c-4b33-4284-9755-c617e26b2d90 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:11.033320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2c222-6eff-4822-b361-3929593deab1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:11.057924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6d13-2629-493e-aece-c1fcfa660ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:11.057924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6d13-2629-493e-aece-c1fcfa660ded None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.057924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6d13-2629-493e-aece-c1fcfa660ded None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.058272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6d13-2629-493e-aece-c1fcfa660ded None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.059680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6d13-2629-493e-aece-c1fcfa660ded None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:11.062164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6d13-2629-493e-aece-c1fcfa660ded None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:11.064239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 171/356] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:10 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:11.065815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e548a2-c219-4c7e-aab7-7c3eb8cd6edf None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.066108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e548a2-c219-4c7e-aab7-7c3eb8cd6edf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.066386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e548a2-c219-4c7e-aab7-7c3eb8cd6edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.079272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:11.080026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.080354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.080627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.088207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:11.089682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:11.091730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 186/357] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:10 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:11.092502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:11.092822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-88e548a2-c219-4c7e-aab7-7c3eb8cd6edf None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:11.094096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-88e548a2-c219-4c7e-aab7-7c3eb8cd6edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:11.102617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.171258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 172/358] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:11.172288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e548a2-c219-4c7e-aab7-7c3eb8cd6edf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:11.206310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29839-721e-4e93-906e-debb1082c657 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:11.254120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:11.254803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.255081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.255349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.256203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:11.256500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:11.257905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:11.269595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 187/359] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:11.270507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:11.276049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.305620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e548a2-c219-4c7e-aab7-7c3eb8cd6edf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:11.350144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8cff7-7cf0-4be2-8ea9-7ab373d86857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:11.350144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8cff7-7cf0-4be2-8ea9-7ab373d86857 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.350144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8cff7-7cf0-4be2-8ea9-7ab373d86857 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.350144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8cff7-7cf0-4be2-8ea9-7ab373d86857 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.351724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8cff7-7cf0-4be2-8ea9-7ab373d86857 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:11.353189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8cff7-7cf0-4be2-8ea9-7ab373d86857 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:11.355000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 173/360] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:11 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:11.356704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef670a-7f5c-4b8c-bb52-e0d3a3be32b0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.356991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef670a-7f5c-4b8c-bb52-e0d3a3be32b0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.357265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef670a-7f5c-4b8c-bb52-e0d3a3be32b0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.358735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 174/361] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:11.359444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef670a-7f5c-4b8c-bb52-e0d3a3be32b0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:11.380521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.402903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15325352-c751-4821-8900-6b4cbde6c323 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:11.445470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75887d-5194-4331-8920-c216102918da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:11.446628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75887d-5194-4331-8920-c216102918da None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.447000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75887d-5194-4331-8920-c216102918da None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.447655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75887d-5194-4331-8920-c216102918da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.448502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75887d-5194-4331-8920-c216102918da None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=2ea31ea6f15646e89ac43281f13adb53) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:11.449093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75887d-5194-4331-8920-c216102918da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:11.451156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75887d-5194-4331-8920-c216102918da None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:11.456899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 188/362] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:11 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:11.464557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75887d-5194-4331-8920-c216102918da None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:11.505830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef670a-7f5c-4b8c-bb52-e0d3a3be32b0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:11.551648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.569864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:11.570390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.570675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.570954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.598831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75887d-5194-4331-8920-c216102918da None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:11.641774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0d064-d47e-4ec6-978e-9564b1ca45e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:11.642505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d064-d47e-4ec6-978e-9564b1ca45e4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.642784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d064-d47e-4ec6-978e-9564b1ca45e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.643058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d064-d47e-4ec6-978e-9564b1ca45e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.643831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0d064-d47e-4ec6-978e-9564b1ca45e4 None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=2ea31ea6f15646e89ac43281f13adb53) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:11.644138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0d064-d47e-4ec6-978e-9564b1ca45e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:11.645829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0d064-d47e-4ec6-978e-9564b1ca45e4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:11.653015 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 189/363] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:11 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=66545c4116b74dad93fef433e2619ef8 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:11.654384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af7b96-28f8-49aa-9187-759345b68343 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:11.654667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af7b96-28f8-49aa-9187-759345b68343 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:11.655025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af7b96-28f8-49aa-9187-759345b68343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:11.656171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:11.657745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:11.673375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.679023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d6af7b96-28f8-49aa-9187-759345b68343 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:11.680599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d6af7b96-28f8-49aa-9187-759345b68343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:11.771358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 190/364] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:11.774357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af7b96-28f8-49aa-9187-759345b68343 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:11.822406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 175/365] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:11.833448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:11.917735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:11.996427 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f39a8-6422-4c0b-8e2f-2e11b9fab684 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.001065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af7b96-28f8-49aa-9187-759345b68343 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.011094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:12.041745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.042399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.042748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.043013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.044669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:12.046127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:12.049236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 176/366] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:11 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:12.056068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:12.075247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854df54-5a35-412f-818d-48be79197029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.075837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854df54-5a35-412f-818d-48be79197029 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.076116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854df54-5a35-412f-818d-48be79197029 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.076385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854df54-5a35-412f-818d-48be79197029 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.096644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854df54-5a35-412f-818d-48be79197029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e854df54-5a35-412f-818d-48be79197029 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:12.101569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:12.102670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:12.103719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 191/367] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:26:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:12.108819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854df54-5a35-412f-818d-48be79197029 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:12.184242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a751d-a97d-4087-b602-def10c6fcfe0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.233489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.234971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.235717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.236136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.238557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:12.240393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:12.247056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 177/368] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:12 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:12.248175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:12.273112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854df54-5a35-412f-818d-48be79197029 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.295394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:12.298952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:12.311435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.312089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.312358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.312634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.313293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:12.314228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:12.315703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:12.324668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 192/369] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:12.325642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:12.364609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69966d-a2f7-4b7b-89eb-abc9c7783341 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.400702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.401783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.402261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.402744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.415240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:12.420873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:12.421764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:12.422562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:12.425144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 178/370] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:12.426136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:12.441337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bc28d-589d-4200-9a69-f9c785210908 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.480156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.480857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.481095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.481369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.482097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=f512fbc0185d45b58058cc54eeb6b126) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:12.482404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:12.483919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:12.490850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 193/371] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:12 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:12.491693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:12.546561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:12.573696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5468-a545-4693-a006-6789491fa0e0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.588984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:12.608423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d87c5d-c1d3-476a-b5ee-4fd2f8d33526 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.629350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.630334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.631055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.631555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.652806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.653532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.653817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.654086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.654817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:12.655121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:12.656573 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:12.678469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 194/372] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:12.684567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:12.789444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:12.790930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:12.896947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ca526-a606-4501-a533-ddb0941ce3f4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:12.916446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:12.961912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:12.962527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:12.962809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:12.963078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:12.980678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 179/373] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:13.001816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:13.010844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:13.088217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:13.089714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:13.200751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 195/374] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:13.206577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:13.217498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:13.234134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bac41-2247-4cac-9d42-3595e841a863 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:13.299138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:13.310299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.310646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.310992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.313668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1ff5a-05a7-479f-b825-218db7e7c6f0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:13.315377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:13.316995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:13.319101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 180/375] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:13 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:13.332821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:13.361497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:13.362180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.362459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.362728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] PATH_INFO: `/v3/projects/11fe830f962e44849f43a8ae423c5eae` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.363899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] RBAC: Authorizing `identity:get_project(project_id=11fe830f962e44849f43a8ae423c5eae)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:13.365448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:13.367481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 196/376] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:13 2022] GET /identity/v3/projects/11fe830f962e44849f43a8ae423c5eae => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:13.373060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:13.455934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:13.466979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:13.481840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ead33-0f56-4854-b217-b93e52e23c66 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:13.503345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1013-d5de-4a8e-9ced-3205b3673475 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:13.525370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:13.526022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.526300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.526615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] PATH_INFO: `/v3/groups/10977be3da4c48d387fc0fb71496771f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.532013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] RBAC: Authorizing `identity:get_group(group_id=10977be3da4c48d387fc0fb71496771f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:13.533551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:13.535640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 197/377] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:13 2022] GET /identity/v3/groups/10977be3da4c48d387fc0fb71496771f => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:13.541945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:13.570031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:13.570685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.570956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.571222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.576412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:13.577885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:13.580119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 181/378] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:13 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:13.586332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:13.648602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae60c-b13c-4bde-986e-2ca800c4c3c5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:13.687525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe1e1-fd79-4600-bddf-d595077a2139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:13.688197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe1e1-fd79-4600-bddf-d595077a2139 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.688476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe1e1-fd79-4600-bddf-d595077a2139 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.688745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe1e1-fd79-4600-bddf-d595077a2139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.689472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe1e1-fd79-4600-bddf-d595077a2139 None admin] RBAC: Adding query filter params (group.id=10977be3da4c48d387fc0fb71496771f, role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=11fe830f962e44849f43a8ae423c5eae) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:13.689773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe1e1-fd79-4600-bddf-d595077a2139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:13.691308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe1e1-fd79-4600-bddf-d595077a2139 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:13.697931 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 198/379] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:13 2022] GET /identity/v3/role_assignments?group.id=10977be3da4c48d387fc0fb71496771f&scope.project.id=11fe830f962e44849f43a8ae423c5eae&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:13.792412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5c3d2-5b8e-40df-bf92-f2c2158fcb01 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:13.842253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf14b-ceb2-466e-ba0b-64afd50da15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:13.842901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf14b-ceb2-466e-ba0b-64afd50da15f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.843171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf14b-ceb2-466e-ba0b-64afd50da15f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.843446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf14b-ceb2-466e-ba0b-64afd50da15f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.844271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf14b-ceb2-466e-ba0b-64afd50da15f None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=f512fbc0185d45b58058cc54eeb6b126) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:13.844581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf14b-ceb2-466e-ba0b-64afd50da15f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:13.846109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf14b-ceb2-466e-ba0b-64afd50da15f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:13.853379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 182/380] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:13 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=66545c4116b74dad93fef433e2619ef8 => generated 260 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:13.894955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f981a-1515-46ff-9b8b-ce0327603ab8 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.895232 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f981a-1515-46ff-9b8b-ce0327603ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.895499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f981a-1515-46ff-9b8b-ce0327603ab8 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.897226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 199/381] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:13.903189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406304-a991-411d-b31a-638d3128d073 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:13.903502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406304-a991-411d-b31a-638d3128d073 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:13.903785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea406304-a991-411d-b31a-638d3128d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:13.930192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:13.937476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ea406304-a991-411d-b31a-638d3128d073 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:13.938733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ea406304-a991-411d-b31a-638d3128d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:14.034259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 183/382] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:14.199372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63268a-6c14-4489-a192-86e079bd38b7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:14.199746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63268a-6c14-4489-a192-86e079bd38b7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:14.199949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63268a-6c14-4489-a192-86e079bd38b7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:14.201633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 200/383] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:14.207019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c148f62-6015-487e-8fc2-94071ac4c569 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:14.207318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c148f62-6015-487e-8fc2-94071ac4c569 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:14.207633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c148f62-6015-487e-8fc2-94071ac4c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:14.232631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5c148f62-6015-487e-8fc2-94071ac4c569 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:14.233903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5c148f62-6015-487e-8fc2-94071ac4c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:14.313112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 184/384] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:14.401397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63268a-6c14-4489-a192-86e079bd38b7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:14.405640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:14.510635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63268a-6c14-4489-a192-86e079bd38b7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:14.545751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:14.546448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:14.546787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:14.547063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:14.558143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:14.563444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:14.564457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:14.565257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 201/385] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:14.571138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c148f62-6015-487e-8fc2-94071ac4c569 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:14.644504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:14.658068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:14.712191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c148f62-6015-487e-8fc2-94071ac4c569 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:14.776794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:14.777335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:14.777606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:14.777871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:14.778544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:14.778840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:14.780240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:14.782595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:14.806124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 185/386] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:14.829528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:14.834832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182e8a9-845d-49e3-ad37-22c432c8f033 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:14.874527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:14.875171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:14.875505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:14.875808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:14.888178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:14.893429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:14.894307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:14.895086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:14.895723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 202/387] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:26:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:14.902227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:15.018167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c8ac-bdd6-4c9d-aa4b-600a0aab1176 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:15.044741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:15.060469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:15.061137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.061415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.061699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.062567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:15.062869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:15.064287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:15.074109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 203/388] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:15.080422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:15.133682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2638f1-211b-4646-af7a-7485bb36d46c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:15.168058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:15.177000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964858cf-e32a-416f-80de-cd2c966648e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:15.177687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964858cf-e32a-416f-80de-cd2c966648e9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.177966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964858cf-e32a-416f-80de-cd2c966648e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.178291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964858cf-e32a-416f-80de-cd2c966648e9 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.179601 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964858cf-e32a-416f-80de-cd2c966648e9 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:15.181068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964858cf-e32a-416f-80de-cd2c966648e9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:15.183012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 186/389] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:14 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:15.184239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d72431-3849-4146-a798-c5c433825f95 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.184578 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d72431-3849-4146-a798-c5c433825f95 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.184783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d72431-3849-4146-a798-c5c433825f95 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.186237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 187/390] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:15.192906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeec06-6566-46ad-8369-305736ddddd5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.192906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeec06-6566-46ad-8369-305736ddddd5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.192906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeec06-6566-46ad-8369-305736ddddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.218548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1aaeec06-6566-46ad-8369-305736ddddd5 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:15.219775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1aaeec06-6566-46ad-8369-305736ddddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:15.220160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacf09-ddfe-418c-a163-f2947bee6522 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:15.277766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:15.278724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.279142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.279552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.281275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:15.283100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:15.285383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 204/391] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:15 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:15.286475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:15.310671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 188/392] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:15.311718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeec06-6566-46ad-8369-305736ddddd5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:15.353752 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:15.402933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4086f-1a95-4b26-bce0-5ae6d217a1f6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:15.437879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeec06-6566-46ad-8369-305736ddddd5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:15.439623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:15.440276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.440555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.440825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.442041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:15.443689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:15.445466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 205/393] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:15 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:15.450943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:15.477792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:15.501224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:15.501878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.502153 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.502814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.508283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:15.509732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:15.511773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 189/394] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:15 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:15.517240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:15.558214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ab197-abc9-4141-8e38-aac20420db4c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:15.582202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:15.602881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:15.603569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.607555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.609583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53/groups/7e20787dab5549c7b75f06bd11d4111b/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.612046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31ea6f15646e89ac43281f13adb53, group_id=7e20787dab5549c7b75f06bd11d4111b, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:15.613531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:15.631535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 206/395] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 16:26:15 2022] PUT /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53/groups/7e20787dab5549c7b75f06bd11d4111b/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:26:15.715726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1060-b4ac-4e84-adea-5e4ae27fb225 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:15.763137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:15.763843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:15.764119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:15.764385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53/groups/7e20787dab5549c7b75f06bd11d4111b/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:15.766553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31ea6f15646e89ac43281f13adb53, group_id=7e20787dab5549c7b75f06bd11d4111b, role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:15.768064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:15.798224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 190/396] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 16:26:15 2022] PUT /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53/groups/7e20787dab5549c7b75f06bd11d4111b/roles/66545c4116b74dad93fef433e2619ef8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:26:15.865202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:15.990409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e597a-0ce7-40be-8fe9-341760269792 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:16.030220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:16.030876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.031157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.031431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.043706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:16.049622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:16.050505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:16.051829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 207/397] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:16.058671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:16.121778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:16.181223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c807c-6c39-433a-b8b6-d12ae1218219 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:16.224607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d63dd-4cdb-4d42-b80b-d22d7bc3b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:16.225588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d63dd-4cdb-4d42-b80b-d22d7bc3b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.226054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d63dd-4cdb-4d42-b80b-d22d7bc3b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.226512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d63dd-4cdb-4d42-b80b-d22d7bc3b7c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.227390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d63dd-4cdb-4d42-b80b-d22d7bc3b7c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:16.227920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d63dd-4cdb-4d42-b80b-d22d7bc3b7c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:16.229464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d63dd-4cdb-4d42-b80b-d22d7bc3b7c0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:16.243098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 191/398] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:16.244856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:16.250628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1013-146c-49ac-891f-8f410f6a8638 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.251182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1013-146c-49ac-891f-8f410f6a8638 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.251666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1013-146c-49ac-891f-8f410f6a8638 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.253811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 192/399] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:16.258949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7979-4532-43d6-bc95-22a94b8c2d74 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.259466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7979-4532-43d6-bc95-22a94b8c2d74 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.260000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7979-4532-43d6-bc95-22a94b8c2d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.293406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0d5d7979-4532-43d6-bc95-22a94b8c2d74 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:16.293406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0d5d7979-4532-43d6-bc95-22a94b8c2d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:16.348800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:16.402629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 193/400] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:16.403929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062709-feaf-4df8-a144-d3b101f9bbfa None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.404263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062709-feaf-4df8-a144-d3b101f9bbfa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.404537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062709-feaf-4df8-a144-d3b101f9bbfa None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.406086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 194/401] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:16.413979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd7e0-2052-4aab-9a6e-6f15df1dbeea None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.414260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd7e0-2052-4aab-9a6e-6f15df1dbeea None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.414533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd7e0-2052-4aab-9a6e-6f15df1dbeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.433756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0b2cd7e0-2052-4aab-9a6e-6f15df1dbeea None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:16.435044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0b2cd7e0-2052-4aab-9a6e-6f15df1dbeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:16.455328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2f8d4-5ead-490b-b0ae-67a3ce7e22a1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:16.481505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:16.509198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 195/402] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:16.533421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:16.534066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.534346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.534615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.535765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:16.537403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:16.539312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 208/403] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:16 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:16.544928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cd7e0-2052-4aab-9a6e-6f15df1dbeea None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:16.688532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cd7e0-2052-4aab-9a6e-6f15df1dbeea None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:16.741712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:16.743180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.743682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.744145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.745490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:16.747121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:16.749369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 196/404] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:16 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:16.755090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:16.785773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:16.853397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:16.897105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35927b3a-a14b-4b0d-a83b-50ced9a8101d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:16.910542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:16.922176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd02d0-d7e2-4048-b705-1d3ac9b5bec7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:16.932217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:16.932889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.933168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.933452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126/groups/7e20787dab5549c7b75f06bd11d4111b/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:16.935357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f512fbc0185d45b58058cc54eeb6b126, group_id=7e20787dab5549c7b75f06bd11d4111b, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:16.936855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:16.954897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 209/405] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 16:26:16 2022] PUT /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126/groups/7e20787dab5549c7b75f06bd11d4111b/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:16.961100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:16.988489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:16.989151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:16.989557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:16.989827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:17.014837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:17.024439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:17.025430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:17.026260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:17.029405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 197/406] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:26:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:17.033918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:17.144687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51617-954c-438d-a417-6c6f4c1800a7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:17.190612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:17.191251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:17.191532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:17.191894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:17.214616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:17.216660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780a92c-cbd3-4b2a-98fd-3931240f5e39 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:17.219215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:17.220159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:17.221040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:17.221832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 210/407] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:17.229598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:17.259459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:17.260125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:17.260450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:17.260726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:17.261404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:17.261703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:17.263077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:17.272502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 198/408] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:17.282457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:17.301025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:17.419404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89a81d-e1de-4929-af08-c8fb16bc8aab None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:17.478081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa587cf-8bfe-4539-afa5-0b5111b05dbe None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:17.489882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:17.491200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:17.491482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:17.491785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:17.492465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:17.492769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:17.494161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:17.507047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 211/409] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:17.516582 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:17.530448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:17.531294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:17.531764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:17.532252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:17.533583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:17.535157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:17.537098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 199/410] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:17 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:17.545388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:17.614931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:17.675062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:17.685400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecba50-61c2-46e4-9e16-cd51310515e1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:17.735867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:17.736423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:17.736702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:17.736976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] PATH_INFO: `/v3/groups/10977be3da4c48d387fc0fb71496771f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:17.741834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] RBAC: Authorizing `identity:get_group(group_id=10977be3da4c48d387fc0fb71496771f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:17.743316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:17.744981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 212/411] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:17 2022] GET /identity/v3/groups/10977be3da4c48d387fc0fb71496771f => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:17.751457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:17.762041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f50645-1a23-456a-92f4-64dd6949cbc0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:17.816909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:17.817560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:17.817843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:17.818122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:17.820126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:17.821669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:17.827551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 200/412] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:17 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:17.829454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:17.943569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a02960-c82b-4b49-bac3-f6de8d76bc15 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:18.004199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aed75-15db-4ef8-ad6c-d0dbb32f6350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:18.004763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aed75-15db-4ef8-ad6c-d0dbb32f6350 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.005045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aed75-15db-4ef8-ad6c-d0dbb32f6350 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.005317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aed75-15db-4ef8-ad6c-d0dbb32f6350 None admin] PATH_INFO: `/v3/projects/11fe830f962e44849f43a8ae423c5eae` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.006942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aed75-15db-4ef8-ad6c-d0dbb32f6350 None admin] RBAC: Authorizing `identity:get_project(project_id=11fe830f962e44849f43a8ae423c5eae)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:18.008652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aed75-15db-4ef8-ad6c-d0dbb32f6350 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:18.010715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 213/413] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:17 2022] GET /identity/v3/projects/11fe830f962e44849f43a8ae423c5eae => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:18.011976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba829d9e-17c3-474f-a347-2ac3aa6e13dc None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.012259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba829d9e-17c3-474f-a347-2ac3aa6e13dc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.012531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba829d9e-17c3-474f-a347-2ac3aa6e13dc None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.014020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 214/414] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:18.015999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba829d9e-17c3-474f-a347-2ac3aa6e13dc None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:18.034106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadff2c-9c9d-40e4-8bb2-fd1a36d6f70d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:18.035779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:18.049825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:18.076450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0dc1b-d8c4-452a-8225-c9cf824ef636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:18.077126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0dc1b-d8c4-452a-8225-c9cf824ef636 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.077410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0dc1b-d8c4-452a-8225-c9cf824ef636 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.077682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0dc1b-d8c4-452a-8225-c9cf824ef636 None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126/groups/7e20787dab5549c7b75f06bd11d4111b/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.079953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0dc1b-d8c4-452a-8225-c9cf824ef636 None admin] RBAC: Authorizing `identity:create_grant(project_id=f512fbc0185d45b58058cc54eeb6b126, group_id=7e20787dab5549c7b75f06bd11d4111b, role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:18.081411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0dc1b-d8c4-452a-8225-c9cf824ef636 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:18.103856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 201/415] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 16:26:17 2022] PUT /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126/groups/7e20787dab5549c7b75f06bd11d4111b/roles/66545c4116b74dad93fef433e2619ef8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:26:18.105529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45642-51c3-4e22-a36f-332f938970c7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.105813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45642-51c3-4e22-a36f-332f938970c7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.106169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae45642-51c3-4e22-a36f-332f938970c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.145171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0ae45642-51c3-4e22-a36f-332f938970c7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:18.146462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0ae45642-51c3-4e22-a36f-332f938970c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:18.159391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba829d9e-17c3-474f-a347-2ac3aa6e13dc None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:18.238673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 202/416] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:18.253017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781a7f3-a18b-46dc-8ff6-fba9b736f25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:18.253706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781a7f3-a18b-46dc-8ff6-fba9b736f25c None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.254068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781a7f3-a18b-46dc-8ff6-fba9b736f25c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.254401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781a7f3-a18b-46dc-8ff6-fba9b736f25c None admin] PATH_INFO: `/v3/projects/11fe830f962e44849f43a8ae423c5eae/groups/10977be3da4c48d387fc0fb71496771f/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.256654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781a7f3-a18b-46dc-8ff6-fba9b736f25c None admin] RBAC: Authorizing `identity:create_grant(project_id=11fe830f962e44849f43a8ae423c5eae, group_id=10977be3da4c48d387fc0fb71496771f, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:18.258198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781a7f3-a18b-46dc-8ff6-fba9b736f25c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:18.276115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 215/417] 10.222.0.88 () {58 vars in 1442 bytes} [Wed Aug 24 16:26:18 2022] PUT /identity/v3/projects/11fe830f962e44849f43a8ae423c5eae/groups/10977be3da4c48d387fc0fb71496771f/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:18.358943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb44a-225b-449c-80af-d244b40aa6b9 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.358943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb44a-225b-449c-80af-d244b40aa6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.358943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb44a-225b-449c-80af-d244b40aa6b9 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.358943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 203/418] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:18.367446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62fee7-750e-4762-8d88-355a14f887a1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.367796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62fee7-750e-4762-8d88-355a14f887a1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.368033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62fee7-750e-4762-8d88-355a14f887a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.394339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-af62fee7-750e-4762-8d88-355a14f887a1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:18.395972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-af62fee7-750e-4762-8d88-355a14f887a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:18.487283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 216/419] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:18.562955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb44a-225b-449c-80af-d244b40aa6b9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:18.678559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:18.693643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb44a-225b-449c-80af-d244b40aa6b9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:18.739466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:18.740206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:18.740486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:18.740755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:18.756196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:18.761015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:18.761927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:18.763198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 204/420] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:18.768317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62fee7-750e-4762-8d88-355a14f887a1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:18.796978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:18.827362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:18.949665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62fee7-750e-4762-8d88-355a14f887a1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:19.001292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9e19-cc1d-41ef-98a2-d431bfd0bace None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:19.018712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:19.019327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.019625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.019899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.020566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:19.020865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:19.022870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:19.047295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 217/421] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:19.052812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:19.074763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:19.075414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.075722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.075995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.092332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:19.097069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:19.097937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:19.098718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:19.099336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 205/422] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:26:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:19.107236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:19.140345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:19.199320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:19.234841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0929-22f1-4327-8121-37be1fee3016 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:19.239036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60ae0c-07bd-4adc-9c7e-7c90e79a45e1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:19.269018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66896817-b454-48c0-8135-bfcac8a5f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:19.269654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896817-b454-48c0-8135-bfcac8a5f582 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.269943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896817-b454-48c0-8135-bfcac8a5f582 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.270218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896817-b454-48c0-8135-bfcac8a5f582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.323282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2059900-6dd2-480d-ac74-56c2ba06972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:19.323928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2059900-6dd2-480d-ac74-56c2ba06972f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.324206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2059900-6dd2-480d-ac74-56c2ba06972f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.324477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2059900-6dd2-480d-ac74-56c2ba06972f None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.325155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2059900-6dd2-480d-ac74-56c2ba06972f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:19.325457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2059900-6dd2-480d-ac74-56c2ba06972f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:19.326835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2059900-6dd2-480d-ac74-56c2ba06972f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:19.338316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 206/423] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:19.339602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4307-7c7e-4890-aa96-d3c9ebdb4f3b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.344022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4307-7c7e-4890-aa96-d3c9ebdb4f3b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.346523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf4307-7c7e-4890-aa96-d3c9ebdb4f3b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.348115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 207/424] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:19.353107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4307-7c7e-4890-aa96-d3c9ebdb4f3b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:19.378883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66896817-b454-48c0-8135-bfcac8a5f582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:19.380548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66896817-b454-48c0-8135-bfcac8a5f582 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:19.444983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:19.472144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf4307-7c7e-4890-aa96-d3c9ebdb4f3b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:19.473185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:19.503243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 218/425] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:26:19.503243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae3308-cd9d-4ad5-bce3-87c2090ae536 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.503243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae3308-cd9d-4ad5-bce3-87c2090ae536 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.503243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae3308-cd9d-4ad5-bce3-87c2090ae536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.524708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-42ae3308-cd9d-4ad5-bce3-87c2090ae536 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:19.526172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-42ae3308-cd9d-4ad5-bce3-87c2090ae536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:19.532300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:19.533140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.533639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.534130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.603870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:19.605751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:19.614505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 219/426] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:19.615603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae3308-cd9d-4ad5-bce3-87c2090ae536 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:19.742813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae3308-cd9d-4ad5-bce3-87c2090ae536 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:19.763114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:19.773750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:19.805668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 208/427] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:19.811607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:19.817074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:19.822810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:19.823334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:19.823831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:19.825278 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:19.826967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:19.831092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 220/428] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:19 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:19.836116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:19.976188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01140f2-6e09-4b1b-b06d-2ed38f8dbf10 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:19.992802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1733a-9c9e-4036-81c2-57432fef8d1b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.015901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.016438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.016721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.016994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] PATH_INFO: `/v3/projects/2ea31ea6f15646e89ac43281f13adb53` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.018177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] RBAC: Authorizing `identity:get_project(project_id=2ea31ea6f15646e89ac43281f13adb53)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.019777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.022654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 209/429] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:19 2022] GET /identity/v3/projects/2ea31ea6f15646e89ac43281f13adb53 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:20.028117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.033091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.033992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.034483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.034947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.036326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.038479 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.041004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 221/430] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:19 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:20.042285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.077894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:20.102489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:20.146293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4efc-0a8e-4ae2-b933-023db66dfc86 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.169751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56f7c-178e-4518-a6a9-c2e62ad24460 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.186250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.187330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.187901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.188388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.200875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:20.206794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:20.207741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:26:20.208541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:20.209886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.209886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.209886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.210128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.211223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.212629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 210/431] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:20.212745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.213835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.218957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 222/432] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:20.218957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.335822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542422e3-61d8-425a-b988-64b08f95eec9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.346571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641354-2e04-471e-8763-5ba76e4574b5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.348597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:20.351228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:20.372985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.373590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.373862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.374367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.374781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] RBAC: Adding query filter params (name=member) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:20.375075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.376485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.385040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 223/433] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:20.385822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.391475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27275725-1a0a-4fda-aead-cf390c226ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.392216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27275725-1a0a-4fda-aead-cf390c226ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.392544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27275725-1a0a-4fda-aead-cf390c226ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.392819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27275725-1a0a-4fda-aead-cf390c226ae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.393557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27275725-1a0a-4fda-aead-cf390c226ae1 None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=2ea31ea6f15646e89ac43281f13adb53) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:20.393865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27275725-1a0a-4fda-aead-cf390c226ae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.395381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27275725-1a0a-4fda-aead-cf390c226ae1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.411627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 211/434] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:20.411627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced88d-7aad-4ae1-8374-9a2c3acc7391 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.411627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced88d-7aad-4ae1-8374-9a2c3acc7391 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.411627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced88d-7aad-4ae1-8374-9a2c3acc7391 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.411627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 212/435] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:20.411627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced88d-7aad-4ae1-8374-9a2c3acc7391 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.519007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c76b2-622a-43f7-ad7f-4ba030f41172 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.532555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced88d-7aad-4ae1-8374-9a2c3acc7391 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.556964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d430a91-585d-4a84-9857-4ce9be71e7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.557575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430a91-585d-4a84-9857-4ce9be71e7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.557855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430a91-585d-4a84-9857-4ce9be71e7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.558121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430a91-585d-4a84-9857-4ce9be71e7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.560054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430a91-585d-4a84-9857-4ce9be71e7c5 None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=2ea31ea6f15646e89ac43281f13adb53) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:20.560377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430a91-585d-4a84-9857-4ce9be71e7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.561953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430a91-585d-4a84-9857-4ce9be71e7c5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.568711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 224/436] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=2ea31ea6f15646e89ac43281f13adb53&role.id=66545c4116b74dad93fef433e2619ef8 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:20.569918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c023-c9a9-4620-b40b-d6935edee491 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.570200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c023-c9a9-4620-b40b-d6935edee491 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.570470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c023-c9a9-4620-b40b-d6935edee491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.573723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.574575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.574988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.575388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.590443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0d85c023-c9a9-4620-b40b-d6935edee491 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:20.592774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0d85c023-c9a9-4620-b40b-d6935edee491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:20.621207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:20.646991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:20.670652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.672721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.695625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 225/437] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:20.695625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d9b2-6d94-4018-95e4-9a96dca608b0 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.695625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d9b2-6d94-4018-95e4-9a96dca608b0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.695625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896d9b2-6d94-4018-95e4-9a96dca608b0 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.695625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 226/438] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:20.700935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f498e3-420b-4daa-b5e9-0e94d3bb4196 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.701504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f498e3-420b-4daa-b5e9-0e94d3bb4196 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.701963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f498e3-420b-4daa-b5e9-0e94d3bb4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.720914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a2f498e3-420b-4daa-b5e9-0e94d3bb4196 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:20.722451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a2f498e3-420b-4daa-b5e9-0e94d3bb4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:20.805922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 213/439] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:20.811224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 227/440] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:20.813188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.884110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:20.920132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad745776-445d-4e62-b042-14dc727b4f40 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:20.954764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:20.955398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:20.955769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:20.956053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:20.957219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:20.958704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:20.960636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 214/441] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:20.966342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f498e3-420b-4daa-b5e9-0e94d3bb4196 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:20.985885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.086431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.089734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f498e3-420b-4daa-b5e9-0e94d3bb4196 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.112939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a531234-367a-477f-9420-7836d3deb3ba None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.133424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.134355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.134751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.135021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.136227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.138392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.140680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 228/442] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:21.144805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.154214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.154867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.155152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.155425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.157949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.169058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:21.174337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:21.175368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:21.176220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 215/443] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:26:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:21.176952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.260011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6fe68-935b-412c-9245-23dc22d009c8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.279854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263a06-74cb-4279-a6ca-19826bc917b8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.295440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.296109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.296383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.296651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.307346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:21.312070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:21.312947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 229/444] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:21.316863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.325285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.325968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.326253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.326523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.327268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=f264736e364b458eb3ef7842c6f5c982, scope.project.id=f512fbc0185d45b58058cc54eeb6b126) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:21.327589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.329052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.335827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 216/445] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=f264736e364b458eb3ef7842c6f5c982 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:21.336718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.352847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.408176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.439885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d293c9-9987-47e5-b8cb-7615baaacab7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.456312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57378420-7562-40f9-8977-5b5e38a1e66f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.477178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.477795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.478071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.478341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.479014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:21.479345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.480738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.489526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 230/446] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:21.494378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.494957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.495062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.495266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.495535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.496238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:21.496536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.497915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.512370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 217/447] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:21.513987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.602365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.615539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd5dd5-6b57-4d48-9934-a22abf6f485e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.644098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecaaf7-8915-40c0-882a-d0f7a8adf592 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.656960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.657672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.657950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.658224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.666986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.683834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621130-efcf-490d-828d-808537f04951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.684455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621130-efcf-490d-828d-808537f04951 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.684733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621130-efcf-490d-828d-808537f04951 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.685005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621130-efcf-490d-828d-808537f04951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.746426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.747982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.754277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621130-efcf-490d-828d-808537f04951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.755796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621130-efcf-490d-828d-808537f04951 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.839022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.850152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 231/448] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:26:21.855501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 218/449] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:21.856002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.861015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621130-efcf-490d-828d-808537f04951 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:21.881221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:21.957915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621130-efcf-490d-828d-808537f04951 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.958196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0183-3cfc-4396-aa3c-0e6c318764fd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:21.992879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.993351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:21.993493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.993777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.993980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:21.994073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] PATH_INFO: `/v3/projects/11fe830f962e44849f43a8ae423c5eae` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.994254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:21.994530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] PATH_INFO: `/v3/projects/f512fbc0185d45b58058cc54eeb6b126` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:21.995125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] RBAC: Authorizing `identity:get_project(project_id=11fe830f962e44849f43a8ae423c5eae)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.995669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] RBAC: Authorizing `identity:get_project(project_id=f512fbc0185d45b58058cc54eeb6b126)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:21.996617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.997108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:21.998341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 219/450] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/projects/11fe830f962e44849f43a8ae423c5eae => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:22.003431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 232/451] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:26:21 2022] GET /identity/v3/projects/f512fbc0185d45b58058cc54eeb6b126 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:22.004254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:22.004388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:22.066104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:22.095676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:22.109156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9095c4-2c36-42e7-94f5-7addba58a613 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:22.109295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc5629-ea45-423d-9852-e7729444af8c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:22.145598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:22.146228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:22.146571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:22.146831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] PATH_INFO: `/v3/groups/10977be3da4c48d387fc0fb71496771f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:22.148030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:22.148197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] RBAC: Authorizing `identity:get_group(group_id=10977be3da4c48d387fc0fb71496771f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:22.148672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:22.148951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:22.149208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] PATH_INFO: `/v3/groups/7e20787dab5549c7b75f06bd11d4111b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:22.149441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:22.150361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] RBAC: Authorizing `identity:get_group(group_id=7e20787dab5549c7b75f06bd11d4111b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:22.151013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 220/452] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:22 2022] GET /identity/v3/groups/10977be3da4c48d387fc0fb71496771f => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:22.151819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:22.153472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 233/453] 10.222.0.88 () {56 vars in 1180 bytes} [Wed Aug 24 16:26:22 2022] GET /identity/v3/groups/7e20787dab5549c7b75f06bd11d4111b => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:22.157821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:22.161052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:22.258026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c04c7-94a9-42ac-8bb8-cd191ec91d64 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:22.259916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e637307-20bf-429b-a4ee-16bd81e00fad None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:22.286003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:22.292237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32876a57-9454-4a1e-b744-da7761163707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:22.292852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32876a57-9454-4a1e-b744-da7761163707 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:22.293127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32876a57-9454-4a1e-b744-da7761163707 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:22.293396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32876a57-9454-4a1e-b744-da7761163707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:22.294134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32876a57-9454-4a1e-b744-da7761163707 None admin] RBAC: Adding query filter params (group.id=10977be3da4c48d387fc0fb71496771f, role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=11fe830f962e44849f43a8ae423c5eae) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:22.294440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32876a57-9454-4a1e-b744-da7761163707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:22.295178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30b8e6-96e6-474f-82eb-3160478f879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:22.295818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30b8e6-96e6-474f-82eb-3160478f879a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:22.295908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32876a57-9454-4a1e-b744-da7761163707 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:22.296093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30b8e6-96e6-474f-82eb-3160478f879a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:22.296356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30b8e6-96e6-474f-82eb-3160478f879a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:22.297074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30b8e6-96e6-474f-82eb-3160478f879a None admin] RBAC: Adding query filter params (group.id=7e20787dab5549c7b75f06bd11d4111b, role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=f512fbc0185d45b58058cc54eeb6b126) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:22.297370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30b8e6-96e6-474f-82eb-3160478f879a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:22.298768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30b8e6-96e6-474f-82eb-3160478f879a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:22.301744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 221/454] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:22 2022] GET /identity/v3/role_assignments?group.id=10977be3da4c48d387fc0fb71496771f&scope.project.id=11fe830f962e44849f43a8ae423c5eae&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:22.311652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 234/455] 10.222.0.88 () {56 vars in 1376 bytes} [Wed Aug 24 16:26:22 2022] GET /identity/v3/role_assignments?group.id=7e20787dab5549c7b75f06bd11d4111b&scope.project.id=f512fbc0185d45b58058cc54eeb6b126&role.id=66545c4116b74dad93fef433e2619ef8 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:24.788711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697bd68-74d9-41e0-9ba0-4310e5c25e81 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:24.789205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697bd68-74d9-41e0-9ba0-4310e5c25e81 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:24.789205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697bd68-74d9-41e0-9ba0-4310e5c25e81 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:24.790826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 222/456] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:24.805921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068357-1671-458f-8ba1-a462c5190761 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:24.806799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068357-1671-458f-8ba1-a462c5190761 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:24.807282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9068357-1671-458f-8ba1-a462c5190761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:24.836668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f9068357-1671-458f-8ba1-a462c5190761 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:24.838307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f9068357-1671-458f-8ba1-a462c5190761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:24.912694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 235/457] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:24.952247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a676-ec67-44e7-9540-98c3af111e80 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:24.952889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a676-ec67-44e7-9540-98c3af111e80 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:24.953356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934a676-ec67-44e7-9540-98c3af111e80 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:24.955187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 223/458] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:24.960413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa830-39a1-43b6-8be1-5e0bfb30b082 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:24.960697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa830-39a1-43b6-8be1-5e0bfb30b082 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:24.960968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa830-39a1-43b6-8be1-5e0bfb30b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:24.986192 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ca4aa830-39a1-43b6-8be1-5e0bfb30b082 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:24.987375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ca4aa830-39a1-43b6-8be1-5e0bfb30b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:25.077123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 236/459] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:25.265531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a676-ec67-44e7-9540-98c3af111e80 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:25.295270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:25.333284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb42e-06ce-46c9-b699-e125cb005253 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.333954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb42e-06ce-46c9-b699-e125cb005253 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.334626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb42e-06ce-46c9-b699-e125cb005253 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.336624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 237/460] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:26:25.342114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d808-5489-4e5a-b44a-dd8765d3125e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.342656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d808-5489-4e5a-b44a-dd8765d3125e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.342985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49d808-5489-4e5a-b44a-dd8765d3125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.386641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6b49d808-5489-4e5a-b44a-dd8765d3125e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:25.387889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6b49d808-5489-4e5a-b44a-dd8765d3125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:25.410922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934a676-ec67-44e7-9540-98c3af111e80 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:25.448220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:25.449249 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.449674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.450086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.461930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:25.463807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:25.480319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:25.481472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:25.482544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:25.482544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:25.482544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:25.484271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 224/461] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:25.490320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:25.491790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:25.516842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 238/462] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:25.518604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49d808-5489-4e5a-b44a-dd8765d3125e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:25.588844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:25.635139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82ff75-778a-43af-acb9-00eb79b475c5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:25.674826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cdd1d-458f-40ed-9043-9b651f4f2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:25.675856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cdd1d-458f-40ed-9043-9b651f4f2c50 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.676326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cdd1d-458f-40ed-9043-9b651f4f2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.676777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cdd1d-458f-40ed-9043-9b651f4f2c50 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.677627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cdd1d-458f-40ed-9043-9b651f4f2c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:25.678235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cdd1d-458f-40ed-9043-9b651f4f2c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:25.680000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cdd1d-458f-40ed-9043-9b651f4f2c50 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:25.693042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 225/463] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:25.695187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c3719-2960-41cd-aeac-1f3da502cb5d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.695693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c3719-2960-41cd-aeac-1f3da502cb5d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.696167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c3719-2960-41cd-aeac-1f3da502cb5d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.696664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49d808-5489-4e5a-b44a-dd8765d3125e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:25.702029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 226/464] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:25.704455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c3719-2960-41cd-aeac-1f3da502cb5d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:25.740674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779640ec-47c0-4544-83aa-d48a71de45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:25.741312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779640ec-47c0-4544-83aa-d48a71de45fc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.741590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779640ec-47c0-4544-83aa-d48a71de45fc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.742105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779640ec-47c0-4544-83aa-d48a71de45fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.763525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779640ec-47c0-4544-83aa-d48a71de45fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:25.765025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779640ec-47c0-4544-83aa-d48a71de45fc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-779640ec-47c0-4544-83aa-d48a71de45fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:25.785703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:25.786665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:25.787543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:25.787543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:25.787543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:25.792126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 239/465] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:25.793079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce38ac5-ae16-446a-a0a5-58bca8a7162b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.793526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce38ac5-ae16-446a-a0a5-58bca8a7162b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.793958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce38ac5-ae16-446a-a0a5-58bca8a7162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.814676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3ce38ac5-ae16-446a-a0a5-58bca8a7162b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:25.817242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3ce38ac5-ae16-446a-a0a5-58bca8a7162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:25.820220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c3719-2960-41cd-aeac-1f3da502cb5d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:25.847634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:25.850662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:25.856511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:25.857132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:25.857414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:25.857691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:25.858336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:25.859837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:25.885914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 227/466] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:26:25 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:25.886751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:25.911653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 240/467] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:25.911653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce38ac5-ae16-446a-a0a5-58bca8a7162b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:26.019553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce38ac5-ae16-446a-a0a5-58bca8a7162b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.058141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.058783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.059067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.059341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.061171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366a5aa-85af-4f62-ace4-9eab95ded846 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.070458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.071978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:26.087414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:26.088399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:26.089266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:26.089266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:26.089266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:26.089880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 241/468] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:26.095564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:26.105039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.105668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.105951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.106222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.106887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:26.107194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.109182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.117880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:26.126935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 228/469] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:26.133896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:26.204066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:26.238703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed0033-b1c2-44ca-aaa0-b16982b34505 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.277739 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9881e-aa2b-472e-b9c7-94f0fbdb7bb3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.279669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.280446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.280884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.281351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.282264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:26.282758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.285062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.306760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 242/470] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:26.308007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:26.323063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.323721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.324011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.324285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.324935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.326456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.353108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 229/471] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:26:26 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:26:26.354046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:26.432244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:26.477667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c6987-7fff-4b44-b810-52c5850b2776 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.482393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b895ed-434b-46f5-9bc1-340387230ccd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.495990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:26.521636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581181fb-6fe6-4bf8-a405-bac9b31186d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.523016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581181fb-6fe6-4bf8-a405-bac9b31186d2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.523299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581181fb-6fe6-4bf8-a405-bac9b31186d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.523709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581181fb-6fe6-4bf8-a405-bac9b31186d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.530231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a41aa3-73b9-4d7b-938a-e79f1f067f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.530951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41aa3-73b9-4d7b-938a-e79f1f067f74 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.531321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41aa3-73b9-4d7b-938a-e79f1f067f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.532271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41aa3-73b9-4d7b-938a-e79f1f067f74 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.532941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a41aa3-73b9-4d7b-938a-e79f1f067f74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.535278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a41aa3-73b9-4d7b-938a-e79f1f067f74 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.535878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581181fb-6fe6-4bf8-a405-bac9b31186d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.537679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581181fb-6fe6-4bf8-a405-bac9b31186d2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-581181fb-6fe6-4bf8-a405-bac9b31186d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:26.556632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:26.557846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:26.559126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:26.559126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:26.559126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:26.559680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 243/472] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:26.561695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cc87f-8fd3-401a-81d4-1bf735b51e79 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.562079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cc87f-8fd3-401a-81d4-1bf735b51e79 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.562838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cc87f-8fd3-401a-81d4-1bf735b51e79 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.568369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 244/473] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:26.568369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cc87f-8fd3-401a-81d4-1bf735b51e79 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:26.571625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 230/474] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:26:26 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:26.572827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6b73-433b-4eba-95c7-bdf8d0e56206 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.573118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6b73-433b-4eba-95c7-bdf8d0e56206 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.573398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6b73-433b-4eba-95c7-bdf8d0e56206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.601401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fa2f6b73-433b-4eba-95c7-bdf8d0e56206 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:26.602740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fa2f6b73-433b-4eba-95c7-bdf8d0e56206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:26.689541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 231/475] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:26.699335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cc87f-8fd3-401a-81d4-1bf735b51e79 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.734944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:26.746089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.746726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.747075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.747405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.748148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:26.748455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.749858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.765539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 245/476] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:26.770701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6b73-433b-4eba-95c7-bdf8d0e56206 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:26.874491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:26.886954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6b73-433b-4eba-95c7-bdf8d0e56206 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:26.924560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:26.925567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:26.926040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:26.926497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:26.927339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:26.929270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:26.958986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 232/477] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:26:26 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:26.989298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:27.129354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9b0e-81f3-4156-a9e5-c95fbe760731 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:27.168699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:27.169319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:27.169598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:27.169871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:27.170545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:27.171974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:27.182204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.sql.core [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:26:27.182204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 16:26:27.182204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [parameters: {'id': 'c8f8a3789c184be39cba64c6a42134c6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 16:26:27.182204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 16:26:27.200276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:26:27.201209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application yield resource Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise self.value Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application session.commit() Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:26:27.202340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:26:27.203370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:26:27.204284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:26:27.205094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [parameters: {'id': 'c8f8a3789c184be39cba64c6a42134c6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:27.205887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 16:26:27.213512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:27.215251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 246/478] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 16:26:26 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:27.215401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:27.323042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f6faf-d8a1-4b20-af08-60a96bf7b1f9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:27.358369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23448e23-6a87-4c0b-8c98-db7422afe241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:27.359355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23448e23-6a87-4c0b-8c98-db7422afe241 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:27.359880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23448e23-6a87-4c0b-8c98-db7422afe241 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:27.360346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23448e23-6a87-4c0b-8c98-db7422afe241 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:27.371503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23448e23-6a87-4c0b-8c98-db7422afe241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-23448e23-6a87-4c0b-8c98-db7422afe241 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:27.377023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:27.378255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:26:27.379036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:27.381360 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 233/479] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:26:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:27.387423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:27.460148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:27.533501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0e847-3364-4c7a-8bc2-89a11fb3e587 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:27.583536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6806429-d875-46c5-bcee-1f1149c48f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:27.584199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806429-d875-46c5-bcee-1f1149c48f40 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:27.584477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806429-d875-46c5-bcee-1f1149c48f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:27.584808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806429-d875-46c5-bcee-1f1149c48f40 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:27.585476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6806429-d875-46c5-bcee-1f1149c48f40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:27.585828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6806429-d875-46c5-bcee-1f1149c48f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:27.587223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6806429-d875-46c5-bcee-1f1149c48f40 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:27.595673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 247/480] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:28.411735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f49d-aa5f-4a7e-a829-f21b580612f7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:28.412319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f49d-aa5f-4a7e-a829-f21b580612f7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:28.412575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1f49d-aa5f-4a7e-a829-f21b580612f7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:28.414415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 234/481] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:28.419953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb88d-3b1b-4120-97c7-7abaeb9ff419 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:28.420394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb88d-3b1b-4120-97c7-7abaeb9ff419 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:28.420574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb88d-3b1b-4120-97c7-7abaeb9ff419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:28.446911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-20fbb88d-3b1b-4120-97c7-7abaeb9ff419 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:28.448161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-20fbb88d-3b1b-4120-97c7-7abaeb9ff419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:28.543111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 248/482] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:28.858629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1f49d-aa5f-4a7e-a829-f21b580612f7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:28.863104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565ebe-266c-4cf3-9abf-05295eedc9be None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:28.863393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565ebe-266c-4cf3-9abf-05295eedc9be None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:28.863707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9565ebe-266c-4cf3-9abf-05295eedc9be None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:28.865425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 249/483] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:28.869263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:28.871673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d4a86-92f9-4b05-8bef-d1bb90240b57 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:28.871915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d4a86-92f9-4b05-8bef-d1bb90240b57 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:28.872147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d4a86-92f9-4b05-8bef-d1bb90240b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:28.904545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fc4d4a86-92f9-4b05-8bef-d1bb90240b57 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:28.905748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc4d4a86-92f9-4b05-8bef-d1bb90240b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:28.968561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:28.987879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1f49d-aa5f-4a7e-a829-f21b580612f7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.032688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 250/484] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:29.049339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484de4e0-73b4-4974-9c9a-7d8db2cc388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:29.049991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de4e0-73b4-4974-9c9a-7d8db2cc388c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.050270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de4e0-73b4-4974-9c9a-7d8db2cc388c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.050540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484de4e0-73b4-4974-9c9a-7d8db2cc388c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.068389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484de4e0-73b4-4974-9c9a-7d8db2cc388c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-484de4e0-73b4-4974-9c9a-7d8db2cc388c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:29.073575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:29.074448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:29.075270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 235/485] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:29.082189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d4a86-92f9-4b05-8bef-d1bb90240b57 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:29.176294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de234030-1748-4d3b-a142-1e7efecc591d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.176828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de234030-1748-4d3b-a142-1e7efecc591d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.177244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de234030-1748-4d3b-a142-1e7efecc591d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.180459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 236/486] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:26:29.186599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b037e7-e50d-43e1-8286-63d71e1ac279 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.188015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b037e7-e50d-43e1-8286-63d71e1ac279 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.188524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b037e7-e50d-43e1-8286-63d71e1ac279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.211030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d1b037e7-e50d-43e1-8286-63d71e1ac279 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:29.213097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d1b037e7-e50d-43e1-8286-63d71e1ac279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:29.241676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d4a86-92f9-4b05-8bef-d1bb90240b57 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.317700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:29.318892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.319601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.320088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.321260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:29.321807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:29.323522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:29.341074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 251/487] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:29.345935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:29.346067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:29.362195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 237/488] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:29.402005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:29.460888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b037e7-e50d-43e1-8286-63d71e1ac279 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:29.515520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f3f6e-199c-4b49-997a-00df97509b38 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.582394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b037e7-e50d-43e1-8286-63d71e1ac279 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.596670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:29.597316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.597593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.597865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.618476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:29.620955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:29.647932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:29.648883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:29.649712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:29.649712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:29.649712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:29.649712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 252/489] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:29.653203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:29.653854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.654132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.654403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.656210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:29.673342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:29.678645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:29.680525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:29.681334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:29.683199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 238/490] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:29.684459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:29.757220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:29.766913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:29.793389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fafda-d830-4553-83c1-ef757316ef74 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.814441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cbe71-2415-4114-bcde-f37426601ff6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.833938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:29.834872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.835052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.835293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.835960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:29.836281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:29.837679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:29.850498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d30d7-fcb5-4ab1-8c10-ed0bbb428d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:29.851196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 253/491] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:29.851306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d30d7-fcb5-4ab1-8c10-ed0bbb428d01 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.851306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d30d7-fcb5-4ab1-8c10-ed0bbb428d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.851563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d30d7-fcb5-4ab1-8c10-ed0bbb428d01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.856277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:29.863308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d30d7-fcb5-4ab1-8c10-ed0bbb428d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-031d30d7-fcb5-4ab1-8c10-ed0bbb428d01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:29.868106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:29.868994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:29.869827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 239/492] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:29.870497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83052e92-9dfd-4798-a2ef-c3b2b541e4a7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:29.871070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83052e92-9dfd-4798-a2ef-c3b2b541e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:29.871070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83052e92-9dfd-4798-a2ef-c3b2b541e4a7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:29.872248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 240/493] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:29.872936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83052e92-9dfd-4798-a2ef-c3b2b541e4a7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:29.972311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e75f0-6b93-4cfb-8d6c-9dd6b887d37b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.980882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83052e92-9dfd-4798-a2ef-c3b2b541e4a7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:29.998446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.010085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.010626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.010904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.011264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.011872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:30.012180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.013625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.018890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736f199-9ad8-45ed-8ac2-20d4649768af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.019532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736f199-9ad8-45ed-8ac2-20d4649768af None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.019854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736f199-9ad8-45ed-8ac2-20d4649768af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.020122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736f199-9ad8-45ed-8ac2-20d4649768af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.023362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 254/494] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:30.024307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.033220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736f199-9ad8-45ed-8ac2-20d4649768af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.034729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736f199-9ad8-45ed-8ac2-20d4649768af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.036817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7736f199-9ad8-45ed-8ac2-20d4649768af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:30.048299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:30.049821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:30.050699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 241/495] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:26:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:30.051259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc2c2f-59e9-4d9c-bdb8-d1bd5d13d8c7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.051259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc2c2f-59e9-4d9c-bdb8-d1bd5d13d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.051874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc2c2f-59e9-4d9c-bdb8-d1bd5d13d8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.070261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-72cc2c2f-59e9-4d9c-bdb8-d1bd5d13d8c7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:30.071498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-72cc2c2f-59e9-4d9c-bdb8-d1bd5d13d8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:30.139918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8646855-0912-4210-8a2a-74d8d83c8263 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.148452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 242/496] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:30.149293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc2c2f-59e9-4d9c-bdb8-d1bd5d13d8c7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.184772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.185914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.186723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.187415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.188493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:30.188935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.191103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.200094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 255/497] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:30.201184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.267278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc2c2f-59e9-4d9c-bdb8-d1bd5d13d8c7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.275802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.276659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.310022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7995785-19e4-455e-a0f8-bee4ffb24ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.310691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7995785-19e4-455e-a0f8-bee4ffb24ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.310964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7995785-19e4-455e-a0f8-bee4ffb24ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.311232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7995785-19e4-455e-a0f8-bee4ffb24ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.318297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09a5c-c428-461d-bd07-5b3c5104a78c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.321854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7995785-19e4-455e-a0f8-bee4ffb24ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.323313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7995785-19e4-455e-a0f8-bee4ffb24ed0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c7995785-19e4-455e-a0f8-bee4ffb24ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:30.338700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:30.339732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:30.341399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:30.341399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:30.341399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:30.341399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 243/498] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:30.341399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf05a3-21a4-45bb-8ee5-e71b1b87dac8 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.341676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf05a3-21a4-45bb-8ee5-e71b1b87dac8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.341917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf05a3-21a4-45bb-8ee5-e71b1b87dac8 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.347847 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 244/499] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:30.347847 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf05a3-21a4-45bb-8ee5-e71b1b87dac8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.366206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.366833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.367111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.367386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.368158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:30.368465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.369922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.407347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 256/500] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:30.408501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.458971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf05a3-21a4-45bb-8ee5-e71b1b87dac8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.493434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f117bf8-ed63-4eb9-b1da-573248290490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.494084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f117bf8-ed63-4eb9-b1da-573248290490 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.494333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f117bf8-ed63-4eb9-b1da-573248290490 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.494603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f117bf8-ed63-4eb9-b1da-573248290490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.505846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f117bf8-ed63-4eb9-b1da-573248290490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.507348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f117bf8-ed63-4eb9-b1da-573248290490 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.511160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3588-9714-4281-8a6c-7a8f9e03d005 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5f117bf8-ed63-4eb9-b1da-573248290490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:30.522399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:30.523318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:30.524413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:30.524413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:30.524413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:30.524413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 245/501] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:30.524848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154bdf-ea92-458c-83bd-a1bcd9b0d3e9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.524928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154bdf-ea92-458c-83bd-a1bcd9b0d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.525220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154bdf-ea92-458c-83bd-a1bcd9b0d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.542810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.543595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6e154bdf-ea92-458c-83bd-a1bcd9b0d3e9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:30.544744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6e154bdf-ea92-458c-83bd-a1bcd9b0d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:30.547628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.552376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.553602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.553898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.554174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.554831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:30.555146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.556577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.568295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 257/502] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:30.569251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.614424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 246/503] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:30.615316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154bdf-ea92-458c-83bd-a1bcd9b0d3e9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.681207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaea5c-292d-4d54-b7b1-8269a9c3c9b1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.716996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.717921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.718209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.718602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.726451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154bdf-ea92-458c-83bd-a1bcd9b0d3e9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.761506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.762351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.762773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.763047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.771203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.774976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:30.778280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:30.779624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:30.780553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:30.781337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 247/504] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:30.781994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.797348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.798838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.888353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6d7a-1b2c-4322-b522-0c414991f14b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:30.906169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 258/505] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:30.907521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.922433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:30.923108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:30.923392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:30.923699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:30.924349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:30.924653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:30.926025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:30.938200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 248/506] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:30.938958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:30.995020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:30.998213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.007481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f00d7e-b78e-4cb9-9553-bf842773988f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.040662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b1f5-887b-4062-8621-32e3178498da None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.042106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.042765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.043015 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.043282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.050644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.052126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:31.064960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:31.065891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:31.066813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 259/507] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:31.067376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.076471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.077087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.077366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.077640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.078305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:31.078608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.080025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.088095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 249/508] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:31.088867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.166825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb9c9-32bd-432f-8a3c-fe02b96447c8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.188676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c647-cd9f-4a86-9c3c-6f2a7829a042 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.203333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.203998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.204276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.204549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.210839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.215720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.217188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.223669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.224316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.224610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.224947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.225442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:31.232085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:31.233084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:31.233925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:31.233925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:31.233925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:31.235759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.235933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 260/509] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:31.236590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.237267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:31.253109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:31.254058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:31.254879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:31.254879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:31.254879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:31.254879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 250/510] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:31.255334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.345934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77f7e5-540a-466d-aa60-74b0fc14bdfe None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.359741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84b081-8dbb-4525-bb17-dc15d334875d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.380382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.381184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.381534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.381730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.390021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.391476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.393364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.393943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.394215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.394485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.395211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:31.395513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.397071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:31.402532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:31.403607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:31.404530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 261/511] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:31.405106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.434750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 251/512] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:31.435610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.465228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.465975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.508436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c5902-37f3-4a2a-be18-7439ccffcc75 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.534369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100351bb-3fa3-4ac2-b1f4-9e5a302654b1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.541518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.542153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.542430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.542695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.553319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.554758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.568545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:31.568837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:31.569859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:31.570733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:31.570733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:31.570733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:31.570894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.570894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.570894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.571075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 262/513] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:31.571141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:31.571141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.571257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.571985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.585545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 252/514] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:31.586518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.671442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04365866-5677-461b-8ad8-1c0340efd3a4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.677768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.684864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.687639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2db8-8c1d-4ccc-ac41-e16bf937ed05 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.705459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.706071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.706350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.706627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.707264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:31.707566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.709179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.720771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 263/515] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:31.721552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.727295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.727946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.728216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.728497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.729219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:31.729519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.730951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.748228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 253/516] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:31.749023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.841917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f885c-e8bb-4d7d-91e6-4cc95aa683fa None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.852166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e5844-fef1-4b7f-bf51-3c5da823b786 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:31.876566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.877154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.877793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.878075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.886502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:31.887124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:31.887403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:31.887702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:31.888349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:31.888651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.890027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:31.901928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 254/517] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:31.902695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:31.916403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.924929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:31.953202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:31.954689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.003734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103969-094f-4671-892b-d2e27b569691 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.036783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.038027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.038311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.038604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.039255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.040752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.057008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 264/518] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:32.057845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.063271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 255/519] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:26:31 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:32.064167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.142960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.146517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.175776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925d88c-b504-409b-9350-9bdb392f598b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.195297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d667b70-0d49-4b1c-9d7c-5144551d44dd None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.217601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.218769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.219119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.219454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.227263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.228806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.237378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.237996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.238278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.238549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:32.241836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:32.242732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:32.243674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 265/520] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:32.244172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.325454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.326934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.352676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d6d15-3978-48a8-93f9-aa4f381fb1bc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.384244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.389971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.390615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.390896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.391169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.397030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.399438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.400952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:32.413728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:32.414861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 266/521] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:32.416566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.444079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 256/522] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:32.445177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.525737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b6ce-b80b-456d-b2d8-439d431d2d36 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.552444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b79b4b-3ef7-487f-9eed-572bec5a6771 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.563120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.563570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.563834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.564112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.575013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.576590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.590389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.590997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:32.591154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:32.592311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:32.593281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:32.593281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:32.593281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:32.593449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.593449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.593449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:32.593449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.594049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.596871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 267/523] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:32.597715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.612815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 257/524] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:32.613483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.644048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.652569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.715295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbcca-4fb6-482e-ac7a-84b6014a061f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.722152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea612e1-66a5-4a75-94fa-440f3aab7a39 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.750297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.750906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.751184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.751453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.752213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:32.752835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.754360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.760307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.761191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.761614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.762024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.771990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 268/525] 10.222.0.88 () {56 vars in 1139 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:32.772812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.778109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.779721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:32.795872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:32.796814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:32.797772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:32.797772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:32.797772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:32.797772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 258/526] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:32.797772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.878842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.881549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6744b-1fc1-47cd-8b44-3005e611ca99 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.883142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:32.901811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880a7fa-282a-426f-9300-91eebbab54ca None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:32.922974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.923588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.923837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.924106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.924747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:32.925046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.926431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.937052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:32.937658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:32.937934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:32.942745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:32.942881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 269/527] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:32.942974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=ff19f92d804245ba908c5609bd133ca2) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:32.942974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:32.943120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:32.943200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:32.955669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 259/528] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/role_assignments?user.id=ff19f92d804245ba908c5609bd133ca2&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:32.955669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.067976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f540cc7-6996-4ea8-ac6a-19223873ffe9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.089101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efbc65-d562-453b-8579-d78a7e6a1557 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.107901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.108821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.109105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.109374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.139099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.140130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.140515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.141318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.142353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:33.142754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.144977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.147745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:33.160047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 260/529] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:33.161061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.164321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:33.193466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.195379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.282159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5527-41fd-4fe4-8afb-8812dc5aa358 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.320137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.320137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.320137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.320137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.320935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 270/530] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:33.322042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.327083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.328611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:33.340864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:33.341915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 261/531] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:33.342763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.391332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:33.412337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:33.438286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba7e44-ec04-42db-9111-5ccef360719f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.458772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375aa20-e842-49e2-a3d0-e94a7d8a0b98 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.475516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.476514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.476983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.477438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.485034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.486756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.495652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.496291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.496574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.496846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:33.500220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:33.501030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:33.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:33.504631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 271/532] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:33.505660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.509533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.511075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:33.526656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:33.527619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:33.528489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:33.528489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:33.528489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:33.532462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 262/533] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:33.533322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.614262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a72fa1-98f0-457a-ada7-24ce885d80ed None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.640430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:33.640624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58eb81-3935-4c10-b218-a544fb20288d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.655386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.655833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:33.656583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.657306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.657800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.658707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:33.659230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.660878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.677994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.678687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.679053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.679332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.680083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:33.680401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.681815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.682989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 272/534] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:33.684098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.695961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 263/535] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:33.696900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.791018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c7edc-b269-4fe7-ba2c-d39dd4ba18e7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.801287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28465703-9843-42e1-bf84-07cc6900f65f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:33.830939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.832035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.832578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.833036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.833870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:33.834405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.836071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.838663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:33.839469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:33.839993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:33.840543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:33.841714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=f0a331472a0040d68824a2245bf3e716) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:33.842029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:33.844127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:33.850152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 264/536] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/role_assignments?user.id=f0a331472a0040d68824a2245bf3e716&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:33.850980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.851605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 273/537] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:33.857806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:33.941008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:33.961272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:34.040361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063de674-7c09-4932-bc23-4b9b2829fbe3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:34.046363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21034861-9dac-4e66-aaa2-ddb21005f7df None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:34.076218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:34.076838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:34.077125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:34.077401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:34.078131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=e6ef2398772541fa85ea0d46d6faf3d7) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:34.078472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:34.079927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:34.087629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 265/538] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/role_assignments?user.id=e6ef2398772541fa85ea0d46d6faf3d7&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:34.094132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd89e2-8d8f-4f85-8f61-749f3d90c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:34.095077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd89e2-8d8f-4f85-8f61-749f3d90c985 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:34.095516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd89e2-8d8f-4f85-8f61-749f3d90c985 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:34.095949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd89e2-8d8f-4f85-8f61-749f3d90c985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:34.103739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd89e2-8d8f-4f85-8f61-749f3d90c985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:34.105395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd89e2-8d8f-4f85-8f61-749f3d90c985 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2ecd89e2-8d8f-4f85-8f61-749f3d90c985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:34.120263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:34.121349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:34.122314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:34.128120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 274/539] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:34.131256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:34.143110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614425-d0cd-464d-a0b3-0ed4966d5892 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:34.143938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614425-d0cd-464d-a0b3-0ed4966d5892 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:34.147107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79614425-d0cd-464d-a0b3-0ed4966d5892 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:34.150581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 275/540] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:34.156669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3af0-de2b-4a0e-806d-fc40564e3dee None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:34.157152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3af0-de2b-4a0e-806d-fc40564e3dee None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:34.157547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3af0-de2b-4a0e-806d-fc40564e3dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:34.195871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b3ac3af0-de2b-4a0e-806d-fc40564e3dee None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:34.200737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3ac3af0-de2b-4a0e-806d-fc40564e3dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:34.296058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e9a2-4178-4b6f-9262-fdb5a38fc6ca None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:34.300028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:34.334338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:34.335080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:34.335368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:34.335665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:34.336568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:34.336700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:34.338210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:34.350902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 266/541] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:34.361321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:34.408022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 276/542] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:34.508120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bf8e6-c697-4355-bdf4-42a2e112dbb0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:34.543917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:34.544530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:34.544893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:34.545152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:34.545795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=2fdb46b5aa2c477d8abce5a1eb9fb68d) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:34.546105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:34.547549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:34.558687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 267/543] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:34 2022] GET /identity/v3/role_assignments?user.id=2fdb46b5aa2c477d8abce5a1eb9fb68d&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:34.807373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac3af0-de2b-4a0e-806d-fc40564e3dee None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:34.848051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:34.932433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac3af0-de2b-4a0e-806d-fc40564e3dee None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:34.977276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:34.978284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:34.978748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:34.979202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:34.990767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:34.995807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:34.996690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:34.997564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:35.000234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 277/544] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:35.006732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:35.039967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:35.112687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de241-37e6-4305-8966-3b5846ce5c9b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:35.147806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9180f6-9c15-44b5-a3d1-95755ae685c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:35.148414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9180f6-9c15-44b5-a3d1-95755ae685c4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:35.148970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9180f6-9c15-44b5-a3d1-95755ae685c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:35.149245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9180f6-9c15-44b5-a3d1-95755ae685c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:35.149905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9180f6-9c15-44b5-a3d1-95755ae685c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:35.150201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9180f6-9c15-44b5-a3d1-95755ae685c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:35.151569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9180f6-9c15-44b5-a3d1-95755ae685c4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:35.160387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 268/545] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:35.166098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:35.179487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e687-94f9-45a2-89d5-a37b707c8442 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:35.179789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e687-94f9-45a2-89d5-a37b707c8442 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:35.180058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e687-94f9-45a2-89d5-a37b707c8442 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:35.181561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 269/546] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:35.194096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f4b4e-3a57-43c5-a05d-ec4bc21f9d09 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:35.194371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f4b4e-3a57-43c5-a05d-ec4bc21f9d09 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:35.194629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f4b4e-3a57-43c5-a05d-ec4bc21f9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:35.222171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-279f4b4e-3a57-43c5-a05d-ec4bc21f9d09 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:35.223390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-279f4b4e-3a57-43c5-a05d-ec4bc21f9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:35.290825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:35.299603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aca715-5c04-48d8-a9a6-8e1887df1296 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:35.349975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 270/547] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:35.368369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:35.368947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:35.369228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:35.369499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:35.388612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:35.390100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:35.405374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:35.406322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:35.407152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:35.407152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:35.407152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:35.412015 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 278/548] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:35.420754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f4b4e-3a57-43c5-a05d-ec4bc21f9d09 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:35.471958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:35.599886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f4b4e-3a57-43c5-a05d-ec4bc21f9d09 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:35.656414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:35.657394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:35.657902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:35.658364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:35.659199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:35.659719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:35.661285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:35.679273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 271/549] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:35.685139 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:35.765960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:35.823124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d919-dc4e-43b7-a464-79b81e7fa0a4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:35.859120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:35.860127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:35.860603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:35.861066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:35.871551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:35.874100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:35.888122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:35.889628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:35.890707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:35.893885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 279/550] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:35.904529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:35.909263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:35.975926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:36.020537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95a5dc-bbca-4723-ae78-760083819508 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:36.071471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa5633-d753-4513-9dbe-35eb6a70967b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:36.093352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:36.093991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.094263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.094527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.116517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:36.121726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:36.122630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:36.123451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 272/551] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:36.130568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:36.147325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:36.147655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.147946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.148220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.148964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:36.149271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:36.150718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:36.191664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 280/552] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 16:26:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:36.209449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:36.250761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7f7ce-a2a9-4e89-8b4d-2b55f8ae4f29 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:36.290715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:36.291320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.291669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.291940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.293025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:36.293328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:36.294976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:36.300827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:36.307671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 273/553] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:36.316513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:36.374041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:36.431043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dbcde-8d13-49dd-a925-c3b15b0fbaf8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:36.449062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28a518-1542-4a93-a1e0-29e115bdca2b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:36.469507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:36.470562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.471202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.471717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.483471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:36.485434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:36.501791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:36.503117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:36.504007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:36.504007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:36.504007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:36.506211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 274/554] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:36.512053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:36.520290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198edb44-8393-44d1-a778-35843c14c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:36.520928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edb44-8393-44d1-a778-35843c14c980 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.521212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edb44-8393-44d1-a778-35843c14c980 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.521518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198edb44-8393-44d1-a778-35843c14c980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.583399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:36.608915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198edb44-8393-44d1-a778-35843c14c980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:36.610787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198edb44-8393-44d1-a778-35843c14c980 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:36.635312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39df48-72ba-4ca9-880d-6b233123adf3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:36.674590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23c88-edac-4172-980a-bb176177a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:36.675201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23c88-edac-4172-980a-bb176177a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.675472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23c88-edac-4172-980a-bb176177a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.675769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23c88-edac-4172-980a-bb176177a3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.676417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23c88-edac-4172-980a-bb176177a3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:36.676824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23c88-edac-4172-980a-bb176177a3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:36.678183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23c88-edac-4172-980a-bb176177a3a9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:36.679774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:36.695340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 275/555] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:36.695340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa1ff-1aa0-46d4-aefa-f68ecebb8ab6 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.695340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa1ff-1aa0-46d4-aefa-f68ecebb8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.695340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fa1ff-1aa0-46d4-aefa-f68ecebb8ab6 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.695340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 276/556] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:36.695840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35412f-8712-4df0-8db7-28ec4e84d899 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.696540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35412f-8712-4df0-8db7-28ec4e84d899 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.696540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35412f-8712-4df0-8db7-28ec4e84d899 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.698246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 277/557] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:36.702156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35412f-8712-4df0-8db7-28ec4e84d899 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:36.725030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 281/558] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:26:36.730672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc31ce-cafb-46be-ad03-3cfeeaaa861f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.730963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc31ce-cafb-46be-ad03-3cfeeaaa861f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.731220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc31ce-cafb-46be-ad03-3cfeeaaa861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.749254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c5dc31ce-cafb-46be-ad03-3cfeeaaa861f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:36.750438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c5dc31ce-cafb-46be-ad03-3cfeeaaa861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:36.806027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35412f-8712-4df0-8db7-28ec4e84d899 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:36.815304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 282/559] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:36.824247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac7f09-eb2e-4435-8ccf-954ed06cd849 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.824247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac7f09-eb2e-4435-8ccf-954ed06cd849 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.824247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac7f09-eb2e-4435-8ccf-954ed06cd849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.825577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:36.840487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1eac7f09-eb2e-4435-8ccf-954ed06cd849 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:36.841828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1eac7f09-eb2e-4435-8ccf-954ed06cd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:36.842499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:36.843210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.843553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.843915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.851201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:36.852728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:36.864124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:36.865076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:36.866084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 278/560] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:36.867279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:36.923980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 283/561] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:36.925245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a57930-d57c-4bc5-ba37-7b24e57af6d3 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:36.925522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a57930-d57c-4bc5-ba37-7b24e57af6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:36.925786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a57930-d57c-4bc5-ba37-7b24e57af6d3 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:36.931238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 284/562] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:36.931238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a57930-d57c-4bc5-ba37-7b24e57af6d3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:36.961319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:36.980306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e19d0-ba2d-4b3f-be86-3cd37d18c5f9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.022204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161bc75-ec10-4d07-9561-f61ac3757513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.023784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161bc75-ec10-4d07-9561-f61ac3757513 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.024211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161bc75-ec10-4d07-9561-f61ac3757513 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.024625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161bc75-ec10-4d07-9561-f61ac3757513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.036010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161bc75-ec10-4d07-9561-f61ac3757513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.038121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161bc75-ec10-4d07-9561-f61ac3757513 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3161bc75-ec10-4d07-9561-f61ac3757513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:37.053147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:37.054131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:37.055011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:37.055011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:37.055011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:37.056323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a57930-d57c-4bc5-ba37-7b24e57af6d3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.057105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 279/563] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:37.058645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31cf6-0b8d-4712-a12b-c2af0f0c20c5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.059074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31cf6-0b8d-4712-a12b-c2af0f0c20c5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.059517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31cf6-0b8d-4712-a12b-c2af0f0c20c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.078749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4ac31cf6-0b8d-4712-a12b-c2af0f0c20c5 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:37.080470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4ac31cf6-0b8d-4712-a12b-c2af0f0c20c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:37.095378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.096041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.096407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.096585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.097315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:37.097620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.099060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.099443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.117799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 285/564] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:37.117799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.166239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 280/565] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:37.166239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31cf6-0b8d-4712-a12b-c2af0f0c20c5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.205378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.227923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280fbb8-cd4f-4249-8cc7-b4c492e1291f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.265945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.266553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.266834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.267112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.267814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:37.268116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.269502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.281217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31cf6-0b8d-4712-a12b-c2af0f0c20c5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.281833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 286/566] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:37.282637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.328252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.328893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.329175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.329444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.340993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:37.346018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:37.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:37.347823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 281/567] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:37.348511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.367784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.403167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f9001-fbed-44d5-81df-e02db2a091d2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.441067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.441702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.441984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.442260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.451749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43dfe-81b6-4983-b5e9-9d4c1532c766 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.452342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.454711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.456445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:37.471079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:37.472065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:37.473115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:37.473115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:37.473115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:37.473115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 287/568] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:37.473493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.490697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.491339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.491641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.491947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.502108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:37.507101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:37.508116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 282/569] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:37.508943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.577998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448186-c488-4d49-a13c-d6fb48309ab4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.583530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.613902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052dc4a-4ddc-43d4-a967-9e392235f534 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.620211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.620840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.621116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.621382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.628582 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.630055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:37.641298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:37.642159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:37.643040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 288/570] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:37.643519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.652802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.653412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.653692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.653962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.654627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:37.654924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.656322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.664611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 283/571] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:37.665401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.695061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.744459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297630d-55d1-44fe-b532-31f520d72c1c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.765727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f79d6-8da9-465c-9cf8-9c6c2778fee1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.778028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.778662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.778937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.779217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.789852 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:37.794928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:37.795873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:37.796782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 289/572] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:37.797487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.801241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.801857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.802132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.802399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.803120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:37.803521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.804810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.807243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.817971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 284/573] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:37.819093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.910628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab132966-7642-4623-959d-31ce5dc5c0f9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.923352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:37.930408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219661-6405-4960-8a5a-60cea0985878 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:37.944730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.945337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.945616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.945885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.946542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:37.946848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.948244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.956084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 290/574] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:37.956850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:37.965431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:37.966041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:37.966320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:37.966591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:37.967278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:37.967595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:37.969020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:37.980549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 285/575] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:37.981392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.038803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.061319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10339599-c6f8-4bea-900f-ba36d7718d14 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.082935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211191-adeb-4f7c-8559-ef40ea0b610f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.094035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.094658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.094934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.095198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.106228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.107782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.116087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.116752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.117151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.117424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.118079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:38.118382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.119854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:38.122115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:38.123062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:38.124001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:38.124001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:38.124001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:38.124001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 291/576] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:38.124230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.128437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 286/577] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:38.129221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.160767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.228796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581dbbf-8969-49dc-bdba-8df72298cca4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.234860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9c6de-f980-4676-89fc-1655eaf9cf1b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.245293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.263855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.264497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.264773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.265039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.269020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.269651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.269930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.270199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.275549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.277011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.277137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.278599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:38.289820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:38.290687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:38.291538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:38.292351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:38.293597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:38.294710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:38.294710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:38.294710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:38.294919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 292/578] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:38.294919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.295078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 287/579] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:38.296183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.383675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.396926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57922-33d7-43cc-8b5c-4e0e2fd30a13 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.398348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e088d-0560-476d-a284-39f2cb786f0b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.431044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.431672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.431947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.432046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.432213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.432624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.432824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:38.432916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.433121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.433210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.433853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=4ed343e58e9d494aa4b303e5bf95b54e) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:38.434158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.434540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.435706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.440967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 293/580] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/role_assignments?user.id=4ed343e58e9d494aa4b303e5bf95b54e&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:38.441734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.446274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 288/581] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:38.447126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.484087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.564794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c4b59-647c-48ab-9715-d233ad18f613 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.565799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba15aa-9f60-4bbf-9a09-cc1c1d0384f3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.602833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.603477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.603790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.604062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.605402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.606270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.606550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.607213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.608006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:38.608312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.609747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.615088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.616696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.627426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 289/582] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:38.627426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:38.637047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:38.638319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:38.639510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:38.639510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:38.639510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:38.641165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 294/583] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:38.642226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.645122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.727120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.737100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbe06c-b024-45b6-9b86-d149e0abed0d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.753914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae60-3ff5-4bc7-8691-690495094de5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.775208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.776031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.776397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.776765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.777506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:38.777909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.779349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.788508 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.789213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.789577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.789954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.795738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 290/584] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:38.796651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.802451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.804003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:38.815665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:38.821296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 295/585] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:38.822461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.888272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.908697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10652c-efbb-4122-ad42-a50eb528a7ec None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.934498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69cfdd-e820-47cb-842d-f730197a2b35 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:38.942755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.943507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.943837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.944107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/ff19f92d804245ba908c5609bd133ca2/roles/8bece968e0a344968a91eab1247ced88` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.958590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=ff19f92d804245ba908c5609bd133ca2, role_id=8bece968e0a344968a91eab1247ced88)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.960138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.969780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:38.970084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:38.970948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:38.971363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:38.971807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:38.972574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:38.972918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:38.974277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:38.983690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 291/586] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:26:38 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/ff19f92d804245ba908c5609bd133ca2/roles/8bece968e0a344968a91eab1247ced88 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:38.985738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:38.992512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 296/587] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:38.993532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.104359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb56b3-ec6d-4f83-b99a-9066f61c68f9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.111025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484e4b-ee42-4b30-942f-b5169fe252b1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.130013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:39.145849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.148325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.148325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.148325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.148576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:39.148893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.150163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.152332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.152975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.153256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.153530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.161866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.163352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.170082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 297/588] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:39.171281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:39.175557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:39.176674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:26:39.177908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:39.178793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 292/589] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:39.181754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.267965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:39.292911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc4e53-9a0a-4c0d-948e-c66d207d38ea None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.301922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3948-6bbe-4f95-89f5-43fe436f7295 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.338525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.339168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.339452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.339756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.340830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.341637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.341987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.342354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.348157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.350279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.353743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.355382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:39.364917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:39.366153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:39.367261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 298/590] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:39.368074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:39.376654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:39.378240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:39.380005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:39.380005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:39.380005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:39.381408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 293/591] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:39.385017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.415152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:39.478697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898bc67-5731-4ba0-a6d4-f1d106f98d72 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.490800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032440b7-564e-4850-8b85-1c0753840cdb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.506034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:39.517736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.518355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.518632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.518904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.519659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:39.519967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.521839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.532562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.533480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.533975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.534461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.535374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:39.536042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.537750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.544618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 299/592] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:39.544618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.562132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 294/593] 10.222.0.88 () {56 vars in 1139 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:39.563300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.650028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:39.655344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17d5e3-f01b-467a-a90f-6d173bdbb73e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.666660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93c674-25e9-4981-be7f-59dca3570021 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.695761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.696646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.696897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.697265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.698071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:39.698472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.700342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.704937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.705755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.706171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.706577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.716908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 300/594] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:39.716908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.721640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.724246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:39.744034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:39.745038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:39.745925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:39.745925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:39.745925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:39.745925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 295/595] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:39.750931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.776812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:39.832862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ffab3-a314-430b-89a0-9e806e0f14af None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.854275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a421f3-ea79-4ad3-ab35-d6659957cb1f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:39.869748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.870390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.870668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.870937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.883439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.884832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.891429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:39.892368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:39.892783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:39.893186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:39.900424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:39.901536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:39.902684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:39.902684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:39.902684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:39.902975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:39.904597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:39.906359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 301/596] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:39.907376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:39.917604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:39.918710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:39.919775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:39.921245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:39.926191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 296/597] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:39.927180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.011562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:40.020987 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cdf3c-9d73-41b2-906f-d98d5c0ccd09 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.031696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b0d80-8365-4e18-b4b3-c25bd97a4381 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.057197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.057833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.058127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.058383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.059026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:40.059329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.060747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.070379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.071256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.071786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.072190 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.073010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:40.074424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.074557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 302/598] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:40.074557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.079688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.093012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 297/599] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:40.094148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.166354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:40.205004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884447a7-977d-4240-921f-d8ca174c8d3f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.219014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64166cf-eefe-4c8e-aa48-85c5827b1175 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.244045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.245294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.245967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.246376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.247435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:40.248268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.250400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.256155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.256881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.257225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.257564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.264896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.265096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 303/600] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:40.266025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.266554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:40.279000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:40.280069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:40.281073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:40.282533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 298/601] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:40.283650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.286411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:40.378691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238b3ce-ab70-4e22-885c-875daab4b6c4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.395074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b9c7e-f0c3-4dd7-96a7-d6cb3fd8f068 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.407973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:40.415162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.415840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.416122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.416851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.423964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.425744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.430417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ef682-6991-49ef-8b53-68ca40163395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.431075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ef682-6991-49ef-8b53-68ca40163395 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.431350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ef682-6991-49ef-8b53-68ca40163395 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.431657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ef682-6991-49ef-8b53-68ca40163395 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/e6ef2398772541fa85ea0d46d6faf3d7/roles/8bece968e0a344968a91eab1247ced88` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:40.437059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:40.437908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 304/602] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:40.444180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.450664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ef682-6991-49ef-8b53-68ca40163395 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=e6ef2398772541fa85ea0d46d6faf3d7, role_id=8bece968e0a344968a91eab1247ced88)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.452331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ef682-6991-49ef-8b53-68ca40163395 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.471681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 299/603] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:26:40 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/e6ef2398772541fa85ea0d46d6faf3d7/roles/8bece968e0a344968a91eab1247ced88 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:40.473106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff35e2f-3a84-45a8-8cda-73f4a235b9e5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.473398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff35e2f-3a84-45a8-8cda-73f4a235b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.473671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff35e2f-3a84-45a8-8cda-73f4a235b9e5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.475296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 300/604] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:40.480544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff35e2f-3a84-45a8-8cda-73f4a235b9e5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.548698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:40.593131 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa88ce5-1aeb-4790-abb9-52413e3092dd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.609570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff35e2f-3a84-45a8-8cda-73f4a235b9e5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.636553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8a6b-6143-4852-b242-7fb0c0b9785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.637189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8a6b-6143-4852-b242-7fb0c0b9785d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.637465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8a6b-6143-4852-b242-7fb0c0b9785d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.637734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8a6b-6143-4852-b242-7fb0c0b9785d None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.638455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8a6b-6143-4852-b242-7fb0c0b9785d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:40.638755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8a6b-6143-4852-b242-7fb0c0b9785d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.640970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8a6b-6143-4852-b242-7fb0c0b9785d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.650927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.651559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.651941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.652219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.652914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:40.653220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.653890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 305/605] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:40.655613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.655726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c93fd-7e8a-4de8-b633-c9bd2106e7aa None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.655726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c93fd-7e8a-4de8-b633-c9bd2106e7aa None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.655726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c93fd-7e8a-4de8-b633-c9bd2106e7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.672240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 301/606] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:40.673073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.680999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cb6c93fd-7e8a-4de8-b633-c9bd2106e7aa None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:40.682391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cb6c93fd-7e8a-4de8-b633-c9bd2106e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:40.733399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:40.758630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 306/607] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:40.759572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c93fd-7e8a-4de8-b633-c9bd2106e7aa None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:40.806115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061b14d-59e0-4560-b616-84f61c71e633 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.819427 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:40.843080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac09ef-fa62-4bce-b569-f11335f0ee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.843813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac09ef-fa62-4bce-b569-f11335f0ee3f None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.844094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac09ef-fa62-4bce-b569-f11335f0ee3f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.844366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac09ef-fa62-4bce-b569-f11335f0ee3f None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/f0a331472a0040d68824a2245bf3e716/roles/8bece968e0a344968a91eab1247ced88` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.862407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac09ef-fa62-4bce-b569-f11335f0ee3f None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=f0a331472a0040d68824a2245bf3e716, role_id=8bece968e0a344968a91eab1247ced88)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.863985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac09ef-fa62-4bce-b569-f11335f0ee3f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.877004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c93fd-7e8a-4de8-b633-c9bd2106e7aa None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:40.881341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 302/608] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:26:40 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/f0a331472a0040d68824a2245bf3e716/roles/8bece968e0a344968a91eab1247ced88 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:40.939693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:40.940727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.941195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.941687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/2fdb46b5aa2c477d8abce5a1eb9fb68d/roles/8bece968e0a344968a91eab1247ced88` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.963665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=2fdb46b5aa2c477d8abce5a1eb9fb68d, role_id=8bece968e0a344968a91eab1247ced88)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:40.965495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:40.982383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb06da8-9973-497c-bfc7-898b99a468d4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.982706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb06da8-9973-497c-bfc7-898b99a468d4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.982974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb06da8-9973-497c-bfc7-898b99a468d4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:40.984619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 303/609] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:26:40.990734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 307/610] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:26:40 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/2fdb46b5aa2c477d8abce5a1eb9fb68d/roles/8bece968e0a344968a91eab1247ced88 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:40.991941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4edd4-f961-4cf6-8e1a-cf912263f675 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:40.992307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4edd4-f961-4cf6-8e1a-cf912263f675 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:40.992680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4edd4-f961-4cf6-8e1a-cf912263f675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:41.026001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9ef4edd4-f961-4cf6-8e1a-cf912263f675 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:41.027266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9ef4edd4-f961-4cf6-8e1a-cf912263f675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:41.113994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:41.124447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 304/611] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:41.154032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:41.231854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeeed4-efe3-4ce1-96be-fa40f106b1a2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:41.267258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:41.268182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:41.268595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:41.269020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:41.279891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:41.284680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:41.285754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:41.286789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:41.289285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 308/612] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:41.295128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4edd4-f961-4cf6-8e1a-cf912263f675 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:41.409850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:41.427109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:41.437200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4edd4-f961-4cf6-8e1a-cf912263f675 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:41.489283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:41.490203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:41.490696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:41.491120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:41.491998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:41.492440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:41.493972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:41.507080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:41.514658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 305/613] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:41.518672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0378-2024-4470-a55b-bc463780d324 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:41.520347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:41.556512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:41.557346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:41.557723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:41.558171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:41.569606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:41.574482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:41.575387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:41.580267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 309/614] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:41.585460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:41.647428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f6b8-f160-458b-ba53-e41976315b51 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:41.682090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:41.682727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:41.683002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:41.683272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:41.694446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:41.696004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:41.710889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:41.711889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:41.713054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:41.713054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:41.713054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:41.713054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 306/615] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:41.720578 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:41.738257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:41.774658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd1a52-c69b-4bf2-8b60-e505aa83f3b0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:41.847310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:41.848347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:41.848819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:41.849295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:41.850316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:41.850808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:41.852642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:41.862721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 310/616] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:41.867802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:41.894069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:41.916496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3a1e4-6e32-4fe0-aaca-25261988e310 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:41.959864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:41.960950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:41.961914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:41.962417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:41.963258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:41.963786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:41.965395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:41.980074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 307/617] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:41.984919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.054289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d76530-70a5-49a7-98ad-1aa06b6294d7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:42.093033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:42.094027 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:42.094496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:42.094987 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:42.107852 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:42.109651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:42.125868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:42.127291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:42.128516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:42.128516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:42.128516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:42.129423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 311/618] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:42.134908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.137736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:42.177496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db963e-a202-4dac-894d-6e162ff26c12 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:42.214496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:42.215544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:42.216037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:42.216543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:42.224770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:42.226773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:42.238879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:42.239939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:42.241014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:42.243922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 308/619] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:42.249168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.297705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:42.359087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a495-4630-4849-888c-2858ae117e93 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:42.379651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974e0b-9233-4c48-8463-15cef5b41e02 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:42.410437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:42.411057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:42.411342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:42.411642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:42.419601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:42.419601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:42.419601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:42.426399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 312/620] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:42.427731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:42.432228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.446582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:42.447522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:42.448987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:42.449512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:42.450458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:42.450993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:42.452682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:42.494108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 309/621] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 16:26:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:42.502557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.619933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc29b0-c03c-4808-91e3-43fb806945e9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:42.648565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e9c6-90c1-4fcc-af49-02b6a7f0acbd None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:42.659163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:42.660159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:42.660641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:42.661130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:42.673336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:42.675093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:42.692078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:42.693085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:42.694044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:42.694044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:42.694044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:42.696501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 310/622] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:42.704493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.710073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:42.729372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:42.730002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:42.730276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:42.730542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:42.741021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:42.742480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:42.763455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:42.764464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:42.765411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:42.769434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 313/623] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:26:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:42.770623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.784260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:42.857940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888eb1-68fa-42d1-a22b-2aaf5f851a27 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:42.893655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769f94-0708-468e-980b-630acc959f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:42.894183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769f94-0708-468e-980b-630acc959f06 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:42.894458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769f94-0708-468e-980b-630acc959f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:42.894732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769f94-0708-468e-980b-630acc959f06 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:42.895372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37769f94-0708-468e-980b-630acc959f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:42.895698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37769f94-0708-468e-980b-630acc959f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:42.897516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37769f94-0708-468e-980b-630acc959f06 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:42.909950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 311/624] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:42.915692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769f94-0708-468e-980b-630acc959f06 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:42.997050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a5481-7b01-4201-957f-1bbd72e26dc6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:43.013450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:43.019462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769f94-0708-468e-980b-630acc959f06 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:43.048597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f59df-dcbf-46a1-b66e-58569a4f2c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:43.049343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f59df-dcbf-46a1-b66e-58569a4f2c35 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.049694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f59df-dcbf-46a1-b66e-58569a4f2c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.049964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f59df-dcbf-46a1-b66e-58569a4f2c35 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.050690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f59df-dcbf-46a1-b66e-58569a4f2c35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:43.050995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f59df-dcbf-46a1-b66e-58569a4f2c35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:43.052487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f59df-dcbf-46a1-b66e-58569a4f2c35 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:43.065499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f721-0047-4130-8679-771caa9d127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:43.066389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f721-0047-4130-8679-771caa9d127d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.066878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f721-0047-4130-8679-771caa9d127d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.067909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f721-0047-4130-8679-771caa9d127d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.071351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 314/625] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:26:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:43.075927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f721-0047-4130-8679-771caa9d127d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:43.077400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224ea2-4fbf-40aa-ac30-c9cb4440905c None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.077690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224ea2-4fbf-40aa-ac30-c9cb4440905c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.077965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224ea2-4fbf-40aa-ac30-c9cb4440905c None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.078207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f721-0047-4130-8679-771caa9d127d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:43.083289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 315/626] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:43.083289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224ea2-4fbf-40aa-ac30-c9cb4440905c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-66c7f721-0047-4130-8679-771caa9d127d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:43.099764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:43.100862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:43.101933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:43.104659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 312/627] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:43.106095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81514a-1af7-4185-a129-95444d1313ae None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.106515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81514a-1af7-4185-a129-95444d1313ae None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.107509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81514a-1af7-4185-a129-95444d1313ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.132670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:43.134718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ec81514a-1af7-4185-a129-95444d1313ae None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:43.136134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ec81514a-1af7-4185-a129-95444d1313ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:43.196865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224ea2-4fbf-40aa-ac30-c9cb4440905c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:43.226245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 313/628] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:43.228624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81514a-1af7-4185-a129-95444d1313ae None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:43.250180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9f3fc-c56c-4a47-9b1e-03bca0538bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:43.251133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f3fc-c56c-4a47-9b1e-03bca0538bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.251546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f3fc-c56c-4a47-9b1e-03bca0538bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.252042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f3fc-c56c-4a47-9b1e-03bca0538bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.357063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:43.357296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9f3fc-c56c-4a47-9b1e-03bca0538bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:43.359309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9f3fc-c56c-4a47-9b1e-03bca0538bd2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:43.380820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81514a-1af7-4185-a129-95444d1313ae None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:43.405583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:43.420068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5d4f1-4357-4626-bfde-b459c6b1dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:43.420878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d4f1-4357-4626-bfde-b459c6b1dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.421152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d4f1-4357-4626-bfde-b459c6b1dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.421422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d4f1-4357-4626-bfde-b459c6b1dfb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.422108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d4f1-4357-4626-bfde-b459c6b1dfb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:43.422408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d4f1-4357-4626-bfde-b459c6b1dfb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:43.423850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d4f1-4357-4626-bfde-b459c6b1dfb8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:43.435663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 314/629] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:43.437172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb1ca-e726-44a1-adfa-19f022670441 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.437603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb1ca-e726-44a1-adfa-19f022670441 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.438036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb1ca-e726-44a1-adfa-19f022670441 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.439684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 315/630] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:43.440860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41798b6-a965-4980-8839-39921d03d807 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.441282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41798b6-a965-4980-8839-39921d03d807 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.441559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41798b6-a965-4980-8839-39921d03d807 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.442728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 316/631] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:43.444361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41798b6-a965-4980-8839-39921d03d807 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:43.476060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 316/632] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:43.477246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e471-7406-4abf-8f6a-91e2d3d9c83c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.477592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e471-7406-4abf-8f6a-91e2d3d9c83c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.477931 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e471-7406-4abf-8f6a-91e2d3d9c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.496170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e824e471-7406-4abf-8f6a-91e2d3d9c83c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:43.497347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e824e471-7406-4abf-8f6a-91e2d3d9c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:43.560579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41798b6-a965-4980-8839-39921d03d807 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:43.568110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 317/633] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:43.569720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ae438-f17d-4c7d-9784-265f35b6ac2c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.570116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ae438-f17d-4c7d-9784-265f35b6ac2c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.570458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ae438-f17d-4c7d-9784-265f35b6ac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.595432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6b0ae438-f17d-4c7d-9784-265f35b6ac2c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:43.595794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:43.596459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.596637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6b0ae438-f17d-4c7d-9784-265f35b6ac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:43.596733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.596999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/4ed343e58e9d494aa4b303e5bf95b54e/roles/8bece968e0a344968a91eab1247ced88` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.612588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=4ed343e58e9d494aa4b303e5bf95b54e, role_id=8bece968e0a344968a91eab1247ced88)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:43.614038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:43.617876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:43.643604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 317/634] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:26:43 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/4ed343e58e9d494aa4b303e5bf95b54e/roles/8bece968e0a344968a91eab1247ced88 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:43.643604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:43.686159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 318/635] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:43.687246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ae438-f17d-4c7d-9784-265f35b6ac2c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:43.691907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:43.807475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16623ed-3dbd-4cbc-b632-c6bf6dfc29c4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:43.846257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:43.846896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.847253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.847744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.859429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:43.861358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:43.865994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ae438-f17d-4c7d-9784-265f35b6ac2c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:43.876961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:43.878273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:43.879156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:43.879156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:43.879156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:43.879156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 318/636] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:43.879644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:43.907811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:43.908642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:43.909082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:43.909322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:43.920819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:43.925882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:43.926805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:43.927657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 319/637] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:43.928963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:43.931101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:43.983497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a47008-14b5-4325-a7fa-4aea170313e6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.019829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.020307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.020597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.020894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.021499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.032981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:44.038166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:44.039215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 319/638] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:44.045313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.046082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb448b2-6f20-401d-b680-c3035f4bcb7d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.084431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.085756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.086134 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.086545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.087298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:44.087910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.089502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.118735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 320/639] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:44.119813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.161560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8956c1-1409-4647-851f-f73a56cbbbb4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.185565 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.231320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.231975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.232263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.232524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.233198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:44.233491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.234869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.235741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9f13d-42e9-4ded-8f8a-b60aecef6a54 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.243738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 320/640] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:44.246465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.265954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.284300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.285940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.286228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.286501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.301669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:44.307163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:44.308154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:44.308998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 321/641] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:44.309672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.374657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a97281-f42a-42b4-bc02-051ec5be741e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.415567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.416660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.416941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.417216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.418147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:44.418448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.420481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.430410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 321/642] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:44.431314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.442226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92df1-5dfd-445c-96d5-28b9950bd439 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.463163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.487283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.487963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.488702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.488979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.498548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.500951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:44.519249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:44.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:44.521178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:44.523348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 322/643] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:44.524319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.552425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119e1da-11a0-43d5-906d-e49aeec35b43 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.578974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.593369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a3007-eef4-40af-8d88-356806945223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.594125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3007-eef4-40af-8d88-356806945223 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.594410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3007-eef4-40af-8d88-356806945223 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.594802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a3007-eef4-40af-8d88-356806945223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.607279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a3007-eef4-40af-8d88-356806945223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.608773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a3007-eef4-40af-8d88-356806945223 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-738a3007-eef4-40af-8d88-356806945223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:44.624876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:44.625786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:44.626836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:44.626836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:44.626836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:44.626836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 322/644] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:44.626836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a3007-eef4-40af-8d88-356806945223 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.642533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952f25-4da9-451f-b65a-7e58418fd467 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.678720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.679352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.679662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.679939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.680620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:44.680915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.682307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.691165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 323/645] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:44.692024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.723072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.739881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a3007-eef4-40af-8d88-356806945223 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.773953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.774607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.774883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.775148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.785724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.787174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:44.803349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:44.804728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:44.805896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:44.805896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:44.805896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:44.805896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 323/646] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:44.805896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.808171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860db388-3624-4d6e-8c9e-41ec5315c82f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.811268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.846498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.847206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.847488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.847785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.848474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:44.848774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.850415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.863827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 324/647] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:44.869706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.911671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4bf9a-a691-4987-bcee-d4f0344c238d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:44.950158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:44.950835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:44.951141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:44.951408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:44.952072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:44.952369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:44.953760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:44.956534 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:44.972272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 324/648] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:44.972272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:44.975894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ffd7a-59d7-4e97-91ae-a249091cf861 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.010109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.010740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.011039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.011287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.021632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.023169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:45.038360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:45.039317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:45.040248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:45.040248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:45.040248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:45.040248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 325/649] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:45.040248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.060292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:45.079879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12496ed1-620e-4c6b-a11b-936d39405f6c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.116369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.117298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.117768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.118226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.119084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:45.119640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.121232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.134958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 325/650] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:45.136058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.149155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b88b6-ab8f-4c63-8665-6dd48eaea417 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.183403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.184039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.184319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.184592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.185357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=ff19f92d804245ba908c5609bd133ca2) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:45.185708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.187154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.193254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 326/651] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/role_assignments?user.id=ff19f92d804245ba908c5609bd133ca2&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:45.200981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.203718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:45.277370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142e06-b479-4106-bce0-204946d9dc61 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.315610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:45.325149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.325922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.326274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.326622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.336052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.338643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.346082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d15f-4363-4c2a-907b-b85fa68f7c0f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:45.355159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:45.356349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:26:45.357417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:45.359525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 326/652] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:45.360982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.394062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.394768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.395112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.395446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.396318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:45.396722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.398318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.415710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 327/653] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:45.416855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.484644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b29c3-d37d-4b7a-a8ef-0d0c9a336eba None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.502952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:45.525532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.526267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.526615 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.526961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.537258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.539532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.540973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85265e8-85a9-47fc-bf23-b4e8f680053a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:45.553445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:45.554452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:45.555374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 327/654] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:45.556235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.581317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.582170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.582588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.582991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.584038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:45.584527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.586255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.596609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:45.608536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 328/655] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:45.613947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.682202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf516f7-fb20-4526-8ff8-09b962c58f27 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.718601 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.719235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.719512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.719810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] PATH_INFO: `/v3/users/glance` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.725052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7178-3253-4920-9b6d-0ef28ce70361 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.727934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.729377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:45.740657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:45.741613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 328/656] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:45.742563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.767521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c2b7-d931-40ef-be75-f495c3f1c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.768165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c2b7-d931-40ef-be75-f495c3f1c11b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.768451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c2b7-d931-40ef-be75-f495c3f1c11b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.768720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c2b7-d931-40ef-be75-f495c3f1c11b None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.769634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c2b7-d931-40ef-be75-f495c3f1c11b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:45.769739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c2b7-d931-40ef-be75-f495c3f1c11b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.771152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c2b7-d931-40ef-be75-f495c3f1c11b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.780037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:45.796302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 329/657] 10.222.0.88 () {56 vars in 1139 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:45.796302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dbf6b-789d-4b45-a4d2-a63c9b00fc8e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.796302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dbf6b-789d-4b45-a4d2-a63c9b00fc8e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.796302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dbf6b-789d-4b45-a4d2-a63c9b00fc8e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.796302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 330/658] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:45.796302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dbf6b-789d-4b45-a4d2-a63c9b00fc8e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.856043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:45.857328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48edd53-02c1-437d-a3ae-4bd94f77e2ed None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.893410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034b3f2-dc06-40e3-b966-83a20b915839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.894017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b3f2-dc06-40e3-b966-83a20b915839 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.894297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b3f2-dc06-40e3-b966-83a20b915839 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.894566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034b3f2-dc06-40e3-b966-83a20b915839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.905098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dbf6b-789d-4b45-a4d2-a63c9b00fc8e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:45.939149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:45.939776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:45.940056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:45.940322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:45.941069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:45.941354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.942781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:45.964805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 331/659] 10.222.0.88 () {56 vars in 1137 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:45.964805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:45.988120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034b3f2-dc06-40e3-b966-83a20b915839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:45.989567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034b3f2-dc06-40e3-b966-83a20b915839 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.026595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.072332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e1956-e96d-4f88-8bd1-a87f6191a12d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.087852 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.100966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 329/660] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:46.102924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c309-f580-4af2-b0a6-88bae9a16c14 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.103280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c309-f580-4af2-b0a6-88bae9a16c14 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.103797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c309-f580-4af2-b0a6-88bae9a16c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.110605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.111424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.111913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.112361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.124336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-55f3c309-f580-4af2-b0a6-88bae9a16c14 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:46.126222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-55f3c309-f580-4af2-b0a6-88bae9a16c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:46.182540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:46.184007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.199064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 330/661] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:46.200202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c309-f580-4af2-b0a6-88bae9a16c14 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.291665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.304021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 332/662] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:46.305037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.323808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.338440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c309-f580-4af2-b0a6-88bae9a16c14 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.373645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.374706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.375272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.375801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.413817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9cc9-7917-47c6-b90e-525b9b22a7c6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.450428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.451060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.451338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.451631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.453576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:46.455329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.462371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:46.463898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:46.479924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:46.480858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:46.481732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:46.481732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:46.481732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:46.481732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 333/663] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:46.482374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.526294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.552073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.571482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 331/664] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:46.571482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.589472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11809e0b-063e-40dc-8907-ae6dba3b1111 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.624219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.624845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.625119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.625383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.636762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:46.638120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:46.652090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:46.653098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:46.653982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:46.653982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:46.653982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:46.653982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 334/665] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:46.653982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.678835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23619cb0-2ad5-46f9-9357-6e0be47dae37 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.714513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.715232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.715508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.715922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.716577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:46.716863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:46.718287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.734021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 332/666] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:46.734021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.761993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.767839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278f2a3-b87d-4116-92da-44a464710be1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.786451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:46.805489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.806047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.806326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.806599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.817169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:46.822421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:46.823340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:46.824193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 335/667] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:46.824896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.843649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a924a3d-5bbe-4344-8371-ca37eea3f53c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.880335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.881005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.881321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.881600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.892876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:46.894345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:46.908912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:46.909915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:46.910810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:46.910810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:46.910810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:46.910810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 333/668] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:46.910810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:46.941599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912a158-8224-4aa8-947e-a33d6f57e5c3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:46.977804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:46.978411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:46.978684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:46.978959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:46.979596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:46.979908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:46.981297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:46.993403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 336/669] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:46.994629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.004443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.033089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f28488-65c7-4e8d-8fe8-be153f1a4875 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.038684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.070408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.070944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.071227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.071500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.078276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.080060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:47.091167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:47.092234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 334/670] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:47.098068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.113253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0210895-298e-4f59-92a9-5b7b2dc63c3e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.150988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.151858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.152294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.152696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.153535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:47.154087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.155704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.164144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 337/671] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:47.165195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.209001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04ab1e-05f2-431d-bff9-498e3b6e8e09 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.248668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.249293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.249573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.250089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.250485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:47.250788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.252193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.260473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.266628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 335/672] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:47.267420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.272323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.275790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ec47-b5e1-4dbf-8465-07737cc067c0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.310556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.311165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.311445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.311762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.318595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.320208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:47.331230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:47.332575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 338/673] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:47.333656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.380455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2e266-8cbe-4bcd-9d94-8e0d534caa22 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.418438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c69f3f-d783-471a-b41a-9c7d29bbfd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.419045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69f3f-d783-471a-b41a-9c7d29bbfd9e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.419327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69f3f-d783-471a-b41a-9c7d29bbfd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.419614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c69f3f-d783-471a-b41a-9c7d29bbfd9e None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.420310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69f3f-d783-471a-b41a-9c7d29bbfd9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:47.420597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69f3f-d783-471a-b41a-9c7d29bbfd9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.422032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c69f3f-d783-471a-b41a-9c7d29bbfd9e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.434144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 336/674] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:47.435415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a185e3-f859-4364-a177-fdb177c8de8a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.435744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a185e3-f859-4364-a177-fdb177c8de8a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.436014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d404db1-814a-4e2f-8721-145ed90b1354 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.436115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a185e3-f859-4364-a177-fdb177c8de8a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.439696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 337/675] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:47.439696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a185e3-f859-4364-a177-fdb177c8de8a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.474215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.474843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.475619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.475619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.486382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.487867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.499945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:47.501864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:47.503135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:47.504068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:47.504068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:47.504068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:47.504068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 339/676] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:47.504713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.522761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.548785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a185e3-f859-4364-a177-fdb177c8de8a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.584196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.584849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.585128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.585417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.592604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.594026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:47.604756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:47.605672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:47.606609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 338/677] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:47.607108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.614512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63f11-5c90-437f-a1ad-1827dd8e49a5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.651007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61a7ca-f2a9-4f67-b5a4-dbffe9e70d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.651647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a7ca-f2a9-4f67-b5a4-dbffe9e70d6c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.651929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a7ca-f2a9-4f67-b5a4-dbffe9e70d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.652203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a7ca-f2a9-4f67-b5a4-dbffe9e70d6c None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.652917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a7ca-f2a9-4f67-b5a4-dbffe9e70d6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:47.653211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a7ca-f2a9-4f67-b5a4-dbffe9e70d6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.654672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61a7ca-f2a9-4f67-b5a4-dbffe9e70d6c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.668230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 340/678] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:47.669343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8068336-98e5-48d3-ae4d-932aa8fb72f3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.669666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8068336-98e5-48d3-ae4d-932aa8fb72f3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.669943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8068336-98e5-48d3-ae4d-932aa8fb72f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.688160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c8068336-98e5-48d3-ae4d-932aa8fb72f3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:47.689351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c8068336-98e5-48d3-ae4d-932aa8fb72f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:47.713965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f2b2e-5aba-44bc-83b2-a616509247bb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.730879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.747797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.748445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.748729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.749017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.749732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=e6ef2398772541fa85ea0d46d6faf3d7) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:47.750037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.751458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.756468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 341/679] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:47.757282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8068336-98e5-48d3-ae4d-932aa8fb72f3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.757799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 339/680] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/role_assignments?user.id=e6ef2398772541fa85ea0d46d6faf3d7&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:47.758361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.781725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:47.898099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa979c-4462-4bc2-b27d-47970df13a65 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.903494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8068336-98e5-48d3-ae4d-932aa8fb72f3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:47.943989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.944721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.944994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.945262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.945953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:47.946255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.948832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.953594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:47.954216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:47.954568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:47.954768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:47.955418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:47.955787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:47.957162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:47.961237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 340/681] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:47.961612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:47.976551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 342/682] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:47.977843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:48.018309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:48.067668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:48.083047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75648-5622-4ee3-af34-256efd358911 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.109882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c082a-36eb-45e6-9d8a-fdc91a97a483 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.123491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.124163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.124403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.124677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.125407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=2fdb46b5aa2c477d8abce5a1eb9fb68d) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:48.125716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:48.127153 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:48.134440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 341/683] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/role_assignments?user.id=2fdb46b5aa2c477d8abce5a1eb9fb68d&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:48.135316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:48.162053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.163707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.164202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.164687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.166478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=f0a331472a0040d68824a2245bf3e716) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:48.167132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:48.169269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:48.186279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 343/684] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:47 2022] GET /identity/v3/role_assignments?user.id=f0a331472a0040d68824a2245bf3e716&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:48.186279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:48.318855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04985d8c-9141-4adb-a7a6-f951ce322d44 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.360796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:48.374892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.375650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc12b-02cc-46c0-a723-2d8daafde609 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.376078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.376078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.376409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.389549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:48.390998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:48.405929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:48.406908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:48.407899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 342/685] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:48.408472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:48.417207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:48.419799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.420636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.420918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.421189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.437604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:48.442893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:48.443938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:48.445008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 344/686] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:48.453412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:48.543711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f979217-e473-44f1-827e-74dc65c8f321 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.564423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44ea1a-3a9b-42ba-b3cc-327a545ce829 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.592374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.594159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.594740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.595238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.596221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:48.596832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:48.599224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:48.603417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.603621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.603780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.604178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.604968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:48.605357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:48.606843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:48.616312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 345/687] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:48.623363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 343/688] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 16:26:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:48.624851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:48.627651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:48.660332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:48.682136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:48.761024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b46b-1fd3-49f2-aa5c-fa66af32e796 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.772911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0213a-069f-413f-9b4b-428b4860fc39 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:48.801522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.802140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.802421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.802753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.860922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:48.861962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:48.862451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:48.862944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:48.880709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:48.882398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:48.887865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:48.889552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:48.912908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:48.913973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:48.914939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:48.914939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:48.914939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:48.917508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:48.920729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 346/689] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:48.921923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.003204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 344/690] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:26:49.009814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.119031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd288a-22fc-424f-b8d6-a7188efd10d9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:49.152102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:49.158609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:49.159863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.159863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.159863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.185450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:49.187209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:49.208746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:49.215189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:49.216185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:49.217076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:49.217076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:49.217076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:49.217076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 345/691] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:49.217315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e216f-3f6f-4d46-bffc-7b4d0b307fac None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:49.225218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.275129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:49.275676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.275956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.276223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.276859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:49.277153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:49.278521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:49.313131 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 347/692] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:49.317620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.413631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8f66f-11fb-43fc-bd34-c03a1c8312ac None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:49.481232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:49.481848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.482121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.482383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.483028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:49.483323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:49.484746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:49.509262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 346/693] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:49.512056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eebdd-8c13-4369-989f-dc67a2be7e4b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:49.514449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.561472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:49.580326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:49.580993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.581270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.581602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.600878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:49.602348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:49.629230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:49.630246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:49.631239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:49.631847 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2262b2-75d8-470a-b4cd-df7e0a9be98b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:49.633869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 348/694] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:49.638547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.667605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:49.668449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.668847 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.669121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.677361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:49.679012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:49.684518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:49.690816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:49.691750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:49.692901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 347/695] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:49.697999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.803232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:49.811712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51376b97-b7c7-41b0-bb20-1763b2568a37 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:49.848758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:49.849646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.850125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.850534 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.851508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:49.851977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:49.853696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:49.867261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 348/696] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:49.871622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be844eb-120a-4f5d-9d17-265a7224a750 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:49.875482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:49.922589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce08fc4-ab80-4e20-aedb-29f4eada6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:49.923540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08fc4-ab80-4e20-aedb-29f4eada6af6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.924242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08fc4-ab80-4e20-aedb-29f4eada6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.925649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08fc4-ab80-4e20-aedb-29f4eada6af6 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.926585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08fc4-ab80-4e20-aedb-29f4eada6af6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:49.927225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08fc4-ab80-4e20-aedb-29f4eada6af6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:49.930266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08fc4-ab80-4e20-aedb-29f4eada6af6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:49.951716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 349/697] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:49.957831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4e6a-9747-4bed-887b-00bfeac205ee None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:49.958308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4e6a-9747-4bed-887b-00bfeac205ee None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:49.958788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4e6a-9747-4bed-887b-00bfeac205ee None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:49.964789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 350/698] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:26:49.964789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4e6a-9747-4bed-887b-00bfeac205ee None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:50.039124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0f3b-9188-4198-b023-7e7210cc0eaf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:50.077858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:50.082294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696b0dd-0823-4fce-b39e-e737481d9605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:50.083402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696b0dd-0823-4fce-b39e-e737481d9605 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.083829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696b0dd-0823-4fce-b39e-e737481d9605 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.084048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696b0dd-0823-4fce-b39e-e737481d9605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.085019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696b0dd-0823-4fce-b39e-e737481d9605 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=4ed343e58e9d494aa4b303e5bf95b54e) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:50.085332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696b0dd-0823-4fce-b39e-e737481d9605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:50.087049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696b0dd-0823-4fce-b39e-e737481d9605 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:50.099532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 349/699] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/role_assignments?user.id=4ed343e58e9d494aa4b303e5bf95b54e&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:50.099532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9014e-516e-4668-a2ae-8cdd08913578 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.099532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9014e-516e-4668-a2ae-8cdd08913578 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.099532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9014e-516e-4668-a2ae-8cdd08913578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.124286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a4e6a-9747-4bed-887b-00bfeac205ee None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:50.137735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0ef9014e-516e-4668-a2ae-8cdd08913578 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:50.138968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0ef9014e-516e-4668-a2ae-8cdd08913578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:50.171649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:50.202476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:50.203103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.203382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.203682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.287317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 350/700] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:50.325155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:50.326757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:50.414781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:50.432946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683afe6-eb4b-4e94-9854-dc9543d1be3e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.433576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683afe6-eb4b-4e94-9854-dc9543d1be3e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.434059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683afe6-eb4b-4e94-9854-dc9543d1be3e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.435896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 351/701] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:26:50.440560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 351/702] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:50.442085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311bb5-db1d-4068-b3bc-1f307e70804a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.442438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311bb5-db1d-4068-b3bc-1f307e70804a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.442777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311bb5-db1d-4068-b3bc-1f307e70804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.447804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:50.468108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e0311bb5-db1d-4068-b3bc-1f307e70804a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:50.469582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e0311bb5-db1d-4068-b3bc-1f307e70804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:50.561405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 352/703] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:50.566515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c54ba-bd31-43f7-9d22-4bafaa92b2f5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:50.602897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:50.603538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.603848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.604116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.615154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:50.616867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:50.634018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311bb5-db1d-4068-b3bc-1f307e70804a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:50.634765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:50.635722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:50.636728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:50.636728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:50.636728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:50.636728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 352/704] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:50.641538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:50.674584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:50.725875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:50.746441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311bb5-db1d-4068-b3bc-1f307e70804a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:50.746764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2dfec-fbae-4064-b60f-3406ace324e1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:50.782449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d269fd3-4af1-477c-8053-78e06cbda662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:50.782810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:50.783069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269fd3-4af1-477c-8053-78e06cbda662 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.783344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269fd3-4af1-477c-8053-78e06cbda662 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.783637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d269fd3-4af1-477c-8053-78e06cbda662 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.784324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.784496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d269fd3-4af1-477c-8053-78e06cbda662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:50.784685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d269fd3-4af1-477c-8053-78e06cbda662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:50.785142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.785612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.786046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d269fd3-4af1-477c-8053-78e06cbda662 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:50.786619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:50.788689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:50.799362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 353/705] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:50.800332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:50.801375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:26:50.802206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:50.805049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 353/706] 10.222.0.88 () {56 vars in 1129 bytes} [Wed Aug 24 16:26:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:50.805303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208af04-4f4b-4c7a-bf54-3c804d93c037 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.810094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208af04-4f4b-4c7a-bf54-3c804d93c037 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.810094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208af04-4f4b-4c7a-bf54-3c804d93c037 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.810094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 354/707] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:50.810947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208af04-4f4b-4c7a-bf54-3c804d93c037 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:50.811647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:50.914581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:50.920043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79342-6fe4-40b4-a1e9-705e077d2c4f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:50.925858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208af04-4f4b-4c7a-bf54-3c804d93c037 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:50.957110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:50.957774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.958061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.958481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.963864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d19a01-cb2c-4d03-a195-2d66f698943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:50.964473 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d19a01-cb2c-4d03-a195-2d66f698943e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.964750 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d19a01-cb2c-4d03-a195-2d66f698943e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.965014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d19a01-cb2c-4d03-a195-2d66f698943e None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.965346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:50.965638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d19a01-cb2c-4d03-a195-2d66f698943e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:50.965926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d19a01-cb2c-4d03-a195-2d66f698943e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:50.966807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:50.967363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d19a01-cb2c-4d03-a195-2d66f698943e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:50.972220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 355/708] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 16:26:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:50.973170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661af7-e2af-4710-9f70-b04e7d2e09b3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:50.973447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661af7-e2af-4710-9f70-b04e7d2e09b3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:50.973710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661af7-e2af-4710-9f70-b04e7d2e09b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:50.983185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:50.984134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 354/709] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:50.989869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:50.992215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a9661af7-e2af-4710-9f70-b04e7d2e09b3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:50.993389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a9661af7-e2af-4710-9f70-b04e7d2e09b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:50.993820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:51.065508 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 356/710] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:51.066449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661af7-e2af-4710-9f70-b04e7d2e09b3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.110407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dabce2-099f-4abb-adc1-7ed4413d5b0d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.145822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.146563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.146967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.147313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] PATH_INFO: `/v3/services/network` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.148039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.149503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:51.158351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:51.159350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:51.160204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 355/711] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:50 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:51.161020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.173438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:51.191049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661af7-e2af-4710-9f70-b04e7d2e09b3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.229278 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.230157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.230690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.231133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.231618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:51.232154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:51.232691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.234221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.248255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 357/712] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 16:26:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:51.249549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.269702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a315f7-059a-44fd-a7fa-0e548052d1ce None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.321508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.322131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.322406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.322679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.323376 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:51.327970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.329499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.358038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 356/713] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:51.366617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.422067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff610f8-d52b-4fd7-becb-da477911a043 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.473038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.473882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.474320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.474732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.476312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:51.476787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.478326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.483345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 358/714] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:26:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:51.484443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.493702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1b11f-6236-4b13-ac39-885f3ccefc7e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.503979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:51.527459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:51.536434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.536763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.537099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.537442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.538890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f928809858b64247862a3901925f8a43, user.id=ff19f92d804245ba908c5609bd133ca2) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:51.539182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.540717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.546935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 357/715] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:51 2022] GET /identity/v3/role_assignments?user.id=ff19f92d804245ba908c5609bd133ca2&scope.project.id=f928809858b64247862a3901925f8a43&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:51.547900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.605885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e2f70-0673-4ba1-9d39-c29f31b1e5e2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.644757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.645782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.646329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.646847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.659089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.660962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:51.679018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:51.680107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:51.681218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:51.681218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:51.681218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:51.683035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 359/716] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:51.689668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.764048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:51.781022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e5785-f64b-4d22-bf48-9132ec9b7d25 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.815115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de9bfc-18d7-4c34-a445-a4cbfadc68a4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:51.850861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.851274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cef5c-3ccf-416f-96d3-51c5c3e12333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:51.851933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cef5c-3ccf-416f-96d3-51c5c3e12333 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.852111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:51.852220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cef5c-3ccf-416f-96d3-51c5c3e12333 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.852474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cef5c-3ccf-416f-96d3-51c5c3e12333 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.852837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:51.853117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cef5c-3ccf-416f-96d3-51c5c3e12333 None admin] RBAC: Adding query filter params (type=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:51.853423 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cef5c-3ccf-416f-96d3-51c5c3e12333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.853534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:51.854283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:51.854723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:51.854827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cef5c-3ccf-416f-96d3-51c5c3e12333 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.856335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:51.870320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 360/717] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:51.876198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:51.879281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 358/718] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:26:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:51.998915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a259ab-24f3-4a05-98d5-e5287337c91d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:52.025360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:52.037701 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a5239-1e25-4d89-ae35-4725bbd2d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:52.038519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5239-1e25-4d89-ae35-4725bbd2d2bd None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:52.038795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5239-1e25-4d89-ae35-4725bbd2d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:52.039067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a5239-1e25-4d89-ae35-4725bbd2d2bd None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:52.039742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a5239-1e25-4d89-ae35-4725bbd2d2bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:52.041178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a5239-1e25-4d89-ae35-4725bbd2d2bd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:52.070768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 361/719] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:26:51 2022] POST /identity/v3/users => generated 254 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:52.600747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583adc-a822-461e-99e1-2925329de1b2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:52.601117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583adc-a822-461e-99e1-2925329de1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:52.601379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61583adc-a822-461e-99e1-2925329de1b2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:52.602947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 359/720] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:52.608462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e7dd4-93f3-46b7-b63f-70788fb7bd50 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:52.608905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e7dd4-93f3-46b7-b63f-70788fb7bd50 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:52.608982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e7dd4-93f3-46b7-b63f-70788fb7bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:52.629150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a62e7dd4-93f3-46b7-b63f-70788fb7bd50 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:52.630329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a62e7dd4-93f3-46b7-b63f-70788fb7bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:52.713494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 362/721] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:53.146349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61583adc-a822-461e-99e1-2925329de1b2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:53.217145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:53.281225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61583adc-a822-461e-99e1-2925329de1b2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:53.329546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:53.330186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:53.330465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:53.330737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:53.351461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:53.356341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:53.357260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:53.358107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:53.358765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 360/722] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:53.363159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e7dd4-93f3-46b7-b63f-70788fb7bd50 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:53.504807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e7dd4-93f3-46b7-b63f-70788fb7bd50 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:53.519974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:53.563050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932e307-2645-4f63-93df-e25732cd8b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:53.563695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e307-2645-4f63-93df-e25732cd8b38 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:53.563977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e307-2645-4f63-93df-e25732cd8b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:53.564251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e307-2645-4f63-93df-e25732cd8b38 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:53.564919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932e307-2645-4f63-93df-e25732cd8b38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:53.565221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932e307-2645-4f63-93df-e25732cd8b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:53.566598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932e307-2645-4f63-93df-e25732cd8b38 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:53.579393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 363/723] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:53.585277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:53.713905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f869f-0d30-4dbc-a78f-370a984438cf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:53.731940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:53.744997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940955e3-112b-4cd5-ad2d-ba68aa34d434 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:53.745536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940955e3-112b-4cd5-ad2d-ba68aa34d434 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:53.745536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940955e3-112b-4cd5-ad2d-ba68aa34d434 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:53.747151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 364/724] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:53.748312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911028-d6d3-43d7-9b26-49bb129a154d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:53.748586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911028-d6d3-43d7-9b26-49bb129a154d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:53.748768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9911028-d6d3-43d7-9b26-49bb129a154d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:53.751072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 365/725] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:53.757284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057065ca-6947-4f5f-b77f-5dec18b62542 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:53.757763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057065ca-6947-4f5f-b77f-5dec18b62542 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:53.758221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057065ca-6947-4f5f-b77f-5dec18b62542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:53.758676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46793b6c-9fd9-400a-a268-15fb6e5595e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:53.759313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46793b6c-9fd9-400a-a268-15fb6e5595e1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:53.759627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46793b6c-9fd9-400a-a268-15fb6e5595e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:53.759908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46793b6c-9fd9-400a-a268-15fb6e5595e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:53.771550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46793b6c-9fd9-400a-a268-15fb6e5595e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:53.773561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46793b6c-9fd9-400a-a268-15fb6e5595e1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:53.780606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-057065ca-6947-4f5f-b77f-5dec18b62542 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:53.782530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-057065ca-6947-4f5f-b77f-5dec18b62542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-46793b6c-9fd9-400a-a268-15fb6e5595e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:53.790962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:53.792210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:53.793394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:53.793394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:53.793394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:53.793394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 361/726] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:53.793680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6b35-d475-4501-928a-183769f37c89 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:53.793841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6b35-d475-4501-928a-183769f37c89 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:53.794112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6b35-d475-4501-928a-183769f37c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:53.822117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c28d6b35-d475-4501-928a-183769f37c89 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:53.823555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c28d6b35-d475-4501-928a-183769f37c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:53.881375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 366/727] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:26:53.883367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057065ca-6947-4f5f-b77f-5dec18b62542 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:53.931984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 362/728] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:54.010910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057065ca-6947-4f5f-b77f-5dec18b62542 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.012373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:54.046108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.046749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.047027 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.047290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.048018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:54.048316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:54.049678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:54.061468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 367/729] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:54.068865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6b35-d475-4501-928a-183769f37c89 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:54.187889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:54.195184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6b35-d475-4501-928a-183769f37c89 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.237553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.238187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.238459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.238727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.248634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:54.254951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:54.257017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:54.277706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:54.278724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:26:54.279745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:54.282132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 363/730] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:54.287431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:54.415026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828f4cf-36e7-4ff0-bf5b-95fed2ea6fd7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.425809 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6a5a9-2a85-4756-8c03-21acd2f3032d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.453151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.453700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.453980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.454273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.461647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a2893-b10a-4609-9e1d-b399c8231eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.462269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a2893-b10a-4609-9e1d-b399c8231eca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.462548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a2893-b10a-4609-9e1d-b399c8231eca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.462819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a2893-b10a-4609-9e1d-b399c8231eca None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.463548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a2893-b10a-4609-9e1d-b399c8231eca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:54.463881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a2893-b10a-4609-9e1d-b399c8231eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:54.464849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:54.465321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a2893-b10a-4609-9e1d-b399c8231eca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:54.469989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:54.470922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:54.471780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:54.476004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 368/731] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:54.477045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:54.489359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 364/732] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 16:26:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:54.489359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d1fa-5221-46c2-a5ff-aa18648a8ddd None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.489359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d1fa-5221-46c2-a5ff-aa18648a8ddd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.489359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d1fa-5221-46c2-a5ff-aa18648a8ddd None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.489359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 365/733] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:54.489359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429d1fa-5221-46c2-a5ff-aa18648a8ddd None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:54.509841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:54.511620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:54.588642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3407f1-4424-46a5-ae88-e5fe57161bb0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.610695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429d1fa-5221-46c2-a5ff-aa18648a8ddd None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.624378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.624972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.625246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.625510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.626210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:54.627603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:54.651634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 369/734] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:26:54 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:54.651634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:54.672366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538f7a-bdf8-4695-b9c7-cc2293960b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.673289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538f7a-bdf8-4695-b9c7-cc2293960b05 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.673892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538f7a-bdf8-4695-b9c7-cc2293960b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.674324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538f7a-bdf8-4695-b9c7-cc2293960b05 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.675754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538f7a-bdf8-4695-b9c7-cc2293960b05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:54.676252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538f7a-bdf8-4695-b9c7-cc2293960b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:54.678115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538f7a-bdf8-4695-b9c7-cc2293960b05 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:54.700574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 366/735] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:54.706432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be1d4-8b07-473d-aa20-32d7291709a2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.706728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be1d4-8b07-473d-aa20-32d7291709a2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.707011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89be1d4-8b07-473d-aa20-32d7291709a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.725914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e89be1d4-8b07-473d-aa20-32d7291709a2 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:54.727171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e89be1d4-8b07-473d-aa20-32d7291709a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:54.766834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:54.789641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd8ab-e71b-4bd2-8ec2-2df05702d3bc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.799778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 367/736] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:54.801701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1bed-011f-45ea-90e9-be8d860948b1 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.802125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1bed-011f-45ea-90e9-be8d860948b1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.802528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c1bed-011f-45ea-90e9-be8d860948b1 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.804672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 368/737] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:54.805972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c1bed-011f-45ea-90e9-be8d860948b1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:54.811111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:54.830513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.831145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.831430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.831746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.914071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:54.915975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:54.937034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c1bed-011f-45ea-90e9-be8d860948b1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:54.982720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd849d9e-4185-49bd-a773-f691160cb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:54.983350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd849d9e-4185-49bd-a773-f691160cb298 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:54.983646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd849d9e-4185-49bd-a773-f691160cb298 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:54.983918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd849d9e-4185-49bd-a773-f691160cb298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:54.996540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd849d9e-4185-49bd-a773-f691160cb298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:54.998494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd849d9e-4185-49bd-a773-f691160cb298 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fd849d9e-4185-49bd-a773-f691160cb298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:55.017928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:55.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:55.019934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:55.019934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:55.019934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:55.019934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 369/738] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:55.020650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33db82-f74b-4d17-926f-a754d78e0996 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.021068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33db82-f74b-4d17-926f-a754d78e0996 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.021454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33db82-f74b-4d17-926f-a754d78e0996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.024520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:55.024954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 370/739] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:26:55.028130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.048151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ed33db82-f74b-4d17-926f-a754d78e0996 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:55.049632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ed33db82-f74b-4d17-926f-a754d78e0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:55.105744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:55.127399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 370/740] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:26:55.128607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33db82-f74b-4d17-926f-a754d78e0996 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.150543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80872b-7fb9-4d8e-825f-f007d4070731 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.190102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:55.190632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.190914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.191183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.191868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:55.192170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:55.193547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:55.208474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 371/741] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:55.209003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.262490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:55.264674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33db82-f74b-4d17-926f-a754d78e0996 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.308222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:55.309418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.309897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.310702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.325463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:55.327688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:55.330098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facd135-8bb8-4507-b5ee-870bf01c1936 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:55.346299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:55.347289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:55.348771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:55.348771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:55.348771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:55.348771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 371/742] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:55.348771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.375417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:55.376691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.377170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.378141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.379297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:55.381372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:55.394750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:55.410115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 372/743] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:26:55 2022] POST /identity/v3/services => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:26:55.411480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.549047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e7c4-a064-4aa1-b8da-0645be3ec1cc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.568001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:55.591273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:55.592702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.593103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.594427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.595239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:55.595548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:55.596609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f4ec-8fec-4e7c-aebc-3a980f68ed5b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.596982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:55.610585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 373/744] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:55.611431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.645787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:55.646549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.646923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.647198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.655339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:55.657592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:55.671016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:55.672072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 372/745] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:55.673023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.744627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1668711-e834-43d0-ae28-9d656144d14a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.790445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:55.794635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:55.795352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ccc1d-271b-482c-91f2-b1ecbf29d107 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.796246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.797460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.798984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.813189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:55.819419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:55.820578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:55.821592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 374/746] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:55.822491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.839228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:55.840085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:55.840425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:55.840758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:55.847681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:55.849650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:55.851638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:55.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:55.865678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:55.867085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:55.870405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 373/747] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:55.871202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:55.959420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2e7c-713d-4317-bbc0-aefa1863a5f0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:55.977226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b674-fb64-4ff7-a7df-89dfab8b9037 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.012472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.013425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.013778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.014126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.015034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:56.015340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.016278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.016816 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.017304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.017785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.018238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.019079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:56.019566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.021143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.035158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 374/748] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:56.036349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 375/749] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:26:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:56.036638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.037465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.061723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:56.139682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:56.151992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3a27-8211-47a2-8bfb-eced8b88b811 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.169889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc5a26-b55f-4d76-bbb7-f102b07796c3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.196536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.197160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.197440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.197712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.198413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:56.198718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.201047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.214426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.215380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.215881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.216449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.222444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 375/750] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:56.222444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.233081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.234845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:56.251026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:56.252043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:56.253260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:56.253260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:56.253260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:56.259954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 376/751] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:56.261059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.322915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:56.356458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb2319-fb1e-4146-ad10-e5a4287cb774 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.393390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.393597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a22c0e-ce82-4787-910f-f5a9dd91526e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.394463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.394945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.395401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.407177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.409017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:56.425220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:56.426248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:56.427150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:56.427150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:56.427150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:56.427318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:56.430458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 376/752] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:56.431756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.435096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.435885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.437057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.437329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.438065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f928809858b64247862a3901925f8a43, user.id=4ed343e58e9d494aa4b303e5bf95b54e) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:56.438375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.439848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.451616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 377/753] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/role_assignments?user.id=4ed343e58e9d494aa4b303e5bf95b54e&scope.project.id=f928809858b64247862a3901925f8a43&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:56.451616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.577662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91589ce-f4af-4b97-adf9-753f39f2b42a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.619543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.620341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.620623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.620894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.621817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:56.622121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.623529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.640506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 378/754] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:56.646805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.666848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b2c67-2097-4bf4-96c1-0fc2ce45c71c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.710836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:56.719030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48390e2f-c579-4464-9035-a00c2f585a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.720331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48390e2f-c579-4464-9035-a00c2f585a6d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.720331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48390e2f-c579-4464-9035-a00c2f585a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.720331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48390e2f-c579-4464-9035-a00c2f585a6d None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.720915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48390e2f-c579-4464-9035-a00c2f585a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:56.721211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48390e2f-c579-4464-9035-a00c2f585a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.722576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48390e2f-c579-4464-9035-a00c2f585a6d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.735354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 377/755] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:56.736515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:56.737524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181426-0e2e-41a3-a0ef-9cbd5b885c16 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.737986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181426-0e2e-41a3-a0ef-9cbd5b885c16 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.738457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181426-0e2e-41a3-a0ef-9cbd5b885c16 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.739908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 378/756] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:56.741068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181426-0e2e-41a3-a0ef-9cbd5b885c16 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.794162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401477a1-7d60-4784-8b13-b4ef3a5987cc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.831121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc30ad-705d-4453-a796-40335d6408bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.831788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc30ad-705d-4453-a796-40335d6408bc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.832036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc30ad-705d-4453-a796-40335d6408bc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.832302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc30ad-705d-4453-a796-40335d6408bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.839430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc30ad-705d-4453-a796-40335d6408bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.840899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc30ad-705d-4453-a796-40335d6408bc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-aebc30ad-705d-4453-a796-40335d6408bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:56.852230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:56.853157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:56.854045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 379/757] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:56.855031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79658e7d-5add-4aa3-baf1-2fd8721dfb77 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.855301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79658e7d-5add-4aa3-baf1-2fd8721dfb77 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.855569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79658e7d-5add-4aa3-baf1-2fd8721dfb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.875512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-79658e7d-5add-4aa3-baf1-2fd8721dfb77 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:56.876717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-79658e7d-5add-4aa3-baf1-2fd8721dfb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:56.885501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181426-0e2e-41a3-a0ef-9cbd5b885c16 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:56.937145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:56.938060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:56.938986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:56.939430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:56.950825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:56.952634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:56.960153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 380/758] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:26:56.961014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79658e7d-5add-4aa3-baf1-2fd8721dfb77 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:26:56.967031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:56.968196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:26:56.969294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:56.972357 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 379/759] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:56.985102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:57.040155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:57.077620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:57.132264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79658e7d-5add-4aa3-baf1-2fd8721dfb77 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:57.152491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05f428-ec88-4ce1-8619-06f88cd07a50 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:57.177948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:57.179458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.179969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.180455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.181350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:57.183497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:57.185190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:57.210803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:57.213726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.214234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.214687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 381/760] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:57.215173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.216196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:57.216703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:57.218326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:57.219366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:57.270162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 380/761] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 16:26:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:57.275719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:57.365735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7372af-45f5-4cdb-a533-63c9276a966f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:57.368571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:57.407283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06077fa-cbc5-42f2-acb3-212d9c54ffdc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:57.419036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:57.420285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:57.421960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.423734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.423734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/ff19f92d804245ba908c5609bd133ca2/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.426078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=ff19f92d804245ba908c5609bd133ca2, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:57.429360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:57.447647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:57.448319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.448601 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.448875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.449541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 382/762] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:26:57 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/ff19f92d804245ba908c5609bd133ca2/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:26:57.450638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:57.595937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1039c-89af-4421-bb35-455d6c454cb6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:57.632896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:57.634490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:57.639053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49a735-7fea-4519-b346-99d142f1a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:57.640787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a735-7fea-4519-b346-99d142f1a673 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.641287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a735-7fea-4519-b346-99d142f1a673 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.641795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49a735-7fea-4519-b346-99d142f1a673 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.642558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49a735-7fea-4519-b346-99d142f1a673 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:57.644212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49a735-7fea-4519-b346-99d142f1a673 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6f49a735-7fea-4519-b346-99d142f1a673 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:57.658832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:57.659914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:57.660757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 383/763] 10.222.0.88 () {56 vars in 1129 bytes} [Wed Aug 24 16:26:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:57.661537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45003a-64aa-43b0-967e-553b0847e7eb None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.662113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45003a-64aa-43b0-967e-553b0847e7eb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.662113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45003a-64aa-43b0-967e-553b0847e7eb None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.664387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 384/764] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:57.671617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226101-d95f-43a7-8407-8a32706b5e34 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.671959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226101-d95f-43a7-8407-8a32706b5e34 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.672235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226101-d95f-43a7-8407-8a32706b5e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.692337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-75226101-d95f-43a7-8407-8a32706b5e34 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:57.693541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-75226101-d95f-43a7-8407-8a32706b5e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:57.715986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:57.776083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 385/765] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:26:57.777025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226101-d95f-43a7-8407-8a32706b5e34 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:57.783923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 381/766] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:26:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:26:57.793285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:57.816005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:57.899409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226101-d95f-43a7-8407-8a32706b5e34 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:57.939211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1342aeb-99ec-44fd-9304-895dab8903cc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:57.941814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33144902-2331-4174-966e-48465672b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:57.942964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33144902-2331-4174-966e-48465672b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.942964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33144902-2331-4174-966e-48465672b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.942964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33144902-2331-4174-966e-48465672b1c1 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:57.943595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33144902-2331-4174-966e-48465672b1c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:57.944111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33144902-2331-4174-966e-48465672b1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:57.945498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33144902-2331-4174-966e-48465672b1c1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:57.950688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 386/767] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 16:26:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:57.956095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33144902-2331-4174-966e-48465672b1c1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:57.979226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:57.992339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:57.992996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:57.993276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:57.993547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.014303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.015867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:58.050524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:58.051521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:58.052570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:58.052570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:58.052570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:58.052570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 382/768] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:58.058950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.063251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33144902-2331-4174-966e-48465672b1c1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.100189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.100854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.101332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.101807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.102857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:58.103353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.104840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.125451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 387/769] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 16:26:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:26:58.126408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.187939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:58.231202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:58.236459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03837a77-7057-4d64-8ed4-8f8a28c73833 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.248552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01066aa3-4d92-4b1e-996a-6835c280290a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.276581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.277693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.278161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.278588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.279486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:58.280047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.281578 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.284805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.285438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.285712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.285980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] PATH_INFO: `/v3/services/network` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.286553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.288484 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.296658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 383/770] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:58.297803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:58.297910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:58.298882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:26:58.299746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:58.305337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 388/771] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:58.305337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.414617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e0a7a-56ce-4925-bd57-fccfb82922ff None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.418820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661314fa-b99b-4069-b5a0-78498d414eac None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.446012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:58.453193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.454081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.454212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.454445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.459496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.461060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.461557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.462028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.462220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.463114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] RBAC: Adding query filter params (interface=public, service_id=769a1bb32a194f54ad8bdd15869723a2, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:58.463696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.463968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.465687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:26:58.479175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:58.480123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 389/773] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:58.481023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.482225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 384/773] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/endpoints?service_id=769a1bb32a194f54ad8bdd15869723a2&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:58.483539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.492044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:58.602271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16452285-ab18-47a5-90e2-01bcd5f6d9a1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.617167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a548-2458-4182-9f5c-99f314c7d44a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.640331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.641363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.641844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.642336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.643145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.644760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.657018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 385/774] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:58.657018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.673754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da8a42-e37b-4583-a59b-2768bc63ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.674517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8a42-e37b-4583-a59b-2768bc63ba34 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.674777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8a42-e37b-4583-a59b-2768bc63ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.675429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da8a42-e37b-4583-a59b-2768bc63ba34 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.675709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da8a42-e37b-4583-a59b-2768bc63ba34 None admin] RBAC: Adding query filter params (name=network) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:58.676005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da8a42-e37b-4583-a59b-2768bc63ba34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.677585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da8a42-e37b-4583-a59b-2768bc63ba34 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.690518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 390/775] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:58.693618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031d704-af88-4ade-a379-84a175755458 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.693922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031d704-af88-4ade-a379-84a175755458 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.694195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031d704-af88-4ade-a379-84a175755458 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.696831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 391/776] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:58.697834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031d704-af88-4ade-a379-84a175755458 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.760041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:58.780890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:58.814669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0773293-f081-4c98-9482-a81e22f88536 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.815866 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031d704-af88-4ade-a379-84a175755458 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:58.853135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.853930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.854353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.854628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.855329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08448594-bcf4-4a65-8d0f-fa174c852c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:58.855470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:58.855774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.855982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08448594-bcf4-4a65-8d0f-fa174c852c91 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.856265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08448594-bcf4-4a65-8d0f-fa174c852c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.856542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08448594-bcf4-4a65-8d0f-fa174c852c91 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.857175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08448594-bcf4-4a65-8d0f-fa174c852c91 None admin] RBAC: Adding query filter params (type=network) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:58.857325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.857503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08448594-bcf4-4a65-8d0f-fa174c852c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:58.859023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08448594-bcf4-4a65-8d0f-fa174c852c91 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:58.864850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 392/777] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:58.866637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05d79-fa16-4b05-80d3-ebb9dc5d1aaf None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:58.866923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05d79-fa16-4b05-80d3-ebb9dc5d1aaf None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:58.867199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05d79-fa16-4b05-80d3-ebb9dc5d1aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:58.871394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 386/778] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:58.872397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:58.894166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c9a05d79-fa16-4b05-80d3-ebb9dc5d1aaf None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:58.895959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c9a05d79-fa16-4b05-80d3-ebb9dc5d1aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:58.981636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 393/779] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:26:58.983641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a05d79-fa16-4b05-80d3-ebb9dc5d1aaf None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:59.017777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c13acb-eed1-4f66-8c5a-8b41bb0f4fc0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:59.048187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:59.064331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:59.100430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a05d79-fa16-4b05-80d3-ebb9dc5d1aaf None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:59.127522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:59.128558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.128839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.129117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.129823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] RBAC: Adding query filter params (interface=public, service_id=380c280f6375457f84b0f4f6f993f718, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:59.130134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:59.131600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:59.150479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 387/780] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/endpoints?service_id=380c280f6375457f84b0f4f6f993f718&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:59.152730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:59.153602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:59.154545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.155010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.155948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.157262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=809566003ec643fe82727431941fe3ce) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:59.158303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:59.161702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:59.175072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 394/781] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:26:58 2022] GET /identity/v3/role_assignments?user.id=809566003ec643fe82727431941fe3ce&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:59.284374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748c35f-bf48-422d-b678-a64afd5b0611 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:59.314120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:59.335507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:59.336168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.336725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.336838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.337439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:59.338828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:59.345442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 388/782] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:26:59 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:59.442847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0a6a4-5752-4d16-830e-b65518a3ea17 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:59.486464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:59.495222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc75e7f-25e7-4cce-a3cf-a53c6416eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:59.496148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75e7f-25e7-4cce-a3cf-a53c6416eaaa None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.496427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75e7f-25e7-4cce-a3cf-a53c6416eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.496696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc75e7f-25e7-4cce-a3cf-a53c6416eaaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.516460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc75e7f-25e7-4cce-a3cf-a53c6416eaaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-0dc75e7f-25e7-4cce-a3cf-a53c6416eaaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:26:59.521233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:59.522242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:26:59.523057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:26:59.524032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 395/783] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:26:59.530143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:59.594071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:59.626614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f5a79-8a4f-45de-9300-d035180f3122 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.626971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f5a79-8a4f-45de-9300-d035180f3122 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.627177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f5a79-8a4f-45de-9300-d035180f3122 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.629174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 396/784] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:26:59.635020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4dd59-b6c5-4ad7-b223-26f9b2a7b250 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.635302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4dd59-b6c5-4ad7-b223-26f9b2a7b250 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.635600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4dd59-b6c5-4ad7-b223-26f9b2a7b250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.673566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1ee4dd59-b6c5-4ad7-b223-26f9b2a7b250 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:26:59.674897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1ee4dd59-b6c5-4ad7-b223-26f9b2a7b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:26:59.700907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e669cf-2007-492a-af2c-6357074b15e6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:59.768889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:59.769515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.769797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.770063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.770728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:26:59.771025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:59.772803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:59.786505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 389/785] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:26:59.788528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:26:59.834413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 397/786] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:26:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:26:59.897147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:26:59.900174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aee0e-37d6-4706-b2f9-6c9d1e769159 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:26:59.934725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:26:59.935351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:26:59.935649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:26:59.935919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:26:59.946409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:26:59.947925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:26:59.963072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:26:59.964106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:26:59.965020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:26:59.965020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:26:59.965020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:26:59.968619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 390/787] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:26:59.970804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4dd59-b6c5-4ad7-b223-26f9b2a7b250 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:00.077688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4dd59-b6c5-4ad7-b223-26f9b2a7b250 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:00.104398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:00.112677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:00.113747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:00.114419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:00.115163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:00.116042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:00.116342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:00.117721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:00.135335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 398/788] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:00.136431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:00.243518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071fc1-eccd-4084-8db3-7fe574783644 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:00.288731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:00.289754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:00.290237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:00.290708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:00.311739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:00.313174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:00.315741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:00.330410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:00.331397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:27:00.332394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:00.335078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 391/789] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:27:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:00.348719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:00.372971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:00.461124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ecd44-79a6-4930-972e-3255bc69c124 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:00.497241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:00.498218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:00.498700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:00.499168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:00.500145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:00.500651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:00.502302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:00.521527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 392/790] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 16:27:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:00.527807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:00.543025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8bbc-aec3-488c-96df-b0a45d3d62d2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:00.582793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:00.583849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:00.584402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:00.585497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:00.597970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:00.603880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:00.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:00.605770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:00.608918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 399/791] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:00.617369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:00.691943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:00.703952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:00.781630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ca0ab-80ec-44cb-83d8-ab4c7f631d50 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:00.793809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e689d-ebe8-474c-acf1-7ef1bcfcef87 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:00.861986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:00.862634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:00.862912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:00.863184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:00.874980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:00.875620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:00.875907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:00.876180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:00.876860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:00.877164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:00.878900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:00.882974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:00.884445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:00.903172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 400/792] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:00.907783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:00.909787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:00.910744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:00.911660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:00.911660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:00.911660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:00.920393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 393/793] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:00.925755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.052213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0885ad-81b1-48e3-ba37-00d64089d1f5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.061943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febb520-70e9-4768-ad6c-db42c9deabfb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.071964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:01.088078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:01.099080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeedbd-f809-48e6-a892-a8a5eeb50df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.099858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeedbd-f809-48e6-a892-a8a5eeb50df3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.100380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeedbd-f809-48e6-a892-a8a5eeb50df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.101353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeedbd-f809-48e6-a892-a8a5eeb50df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.103628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bdce4-d9a0-4094-948b-199240dda052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.104462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bdce4-d9a0-4094-948b-199240dda052 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.104917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bdce4-d9a0-4094-948b-199240dda052 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.105361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bdce4-d9a0-4094-948b-199240dda052 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.106180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bdce4-d9a0-4094-948b-199240dda052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:01.106655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bdce4-d9a0-4094-948b-199240dda052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.108461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bdce4-d9a0-4094-948b-199240dda052 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.113777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeedbd-f809-48e6-a892-a8a5eeb50df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.115340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeedbd-f809-48e6-a892-a8a5eeb50df3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.122396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 394/794] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:01.123898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936013-1792-4490-8bef-c79c315a5e1e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.124397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936013-1792-4490-8bef-c79c315a5e1e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.124889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936013-1792-4490-8bef-c79c315a5e1e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.130926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 395/795] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:01.132302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936013-1792-4490-8bef-c79c315a5e1e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6cfeedbd-f809-48e6-a892-a8a5eeb50df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:01.133260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:01.134171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:01.135049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:01.135049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:01.135049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:01.135049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 401/796] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:01.135968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaffa44-620b-4abd-952d-4a325d0ff669 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.136250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaffa44-620b-4abd-952d-4a325d0ff669 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.136523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaffa44-620b-4abd-952d-4a325d0ff669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.165610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0aaffa44-620b-4abd-952d-4a325d0ff669 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:01.167414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0aaffa44-620b-4abd-952d-4a325d0ff669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:01.244017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 402/797] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:01.245273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaffa44-620b-4abd-952d-4a325d0ff669 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.265316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936013-1792-4490-8bef-c79c315a5e1e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.307654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.307654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.307654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.307654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.315553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.317231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:01.331983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:01.332911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:01.333794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 396/798] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:01.339143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.415958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:01.424264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaffa44-620b-4abd-952d-4a325d0ff669 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.447959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:01.466874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9d7d-824c-4ef5-9bf8-ebcc52478921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.467492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9d7d-824c-4ef5-9bf8-ebcc52478921 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.467883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9d7d-824c-4ef5-9bf8-ebcc52478921 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.468081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9d7d-824c-4ef5-9bf8-ebcc52478921 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.468721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d9d7d-824c-4ef5-9bf8-ebcc52478921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:01.469077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d9d7d-824c-4ef5-9bf8-ebcc52478921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.470471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d9d7d-824c-4ef5-9bf8-ebcc52478921 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.487178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 403/799] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:01.487178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a83da-1fa7-4856-876d-2305510f38b8 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.487178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a83da-1fa7-4856-876d-2305510f38b8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.487178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a83da-1fa7-4856-876d-2305510f38b8 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.487178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 404/800] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:01.496972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a83da-1fa7-4856-876d-2305510f38b8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.521198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424e11-86f4-489c-84d0-72fbb135c598 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.557605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad916a-8254-46ae-b8bc-aceb4dabe7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.558577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad916a-8254-46ae-b8bc-aceb4dabe7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.559008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad916a-8254-46ae-b8bc-aceb4dabe7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.559413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad916a-8254-46ae-b8bc-aceb4dabe7d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.560290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad916a-8254-46ae-b8bc-aceb4dabe7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:01.560837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad916a-8254-46ae-b8bc-aceb4dabe7d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.562662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad916a-8254-46ae-b8bc-aceb4dabe7d2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.576398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 397/801] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:01.577955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23257-6b4a-4f09-ab00-3767ab9a402a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.578378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23257-6b4a-4f09-ab00-3767ab9a402a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.578791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23257-6b4a-4f09-ab00-3767ab9a402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.596827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b4d23257-6b4a-4f09-ab00-3767ab9a402a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:01.598016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b4d23257-6b4a-4f09-ab00-3767ab9a402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:01.619743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a83da-1fa7-4856-876d-2305510f38b8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.656454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.657113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.657365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.657723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.666051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.667519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.668162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 398/802] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:01.669008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23257-6b4a-4f09-ab00-3767ab9a402a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:01.688298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:01.689317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:01.690269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:01.697080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 405/803] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:27:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:01.698220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.703415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:01.711375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:01.786283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23257-6b4a-4f09-ab00-3767ab9a402a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.810426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faccaa-bed3-4b74-ae4c-f61372baea1f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:01.827096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.827783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.828065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.828341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.828930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.830465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:01.839775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:01.840733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:01.841581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 399/804] 10.222.0.88 () {56 vars in 1129 bytes} [Wed Aug 24 16:27:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:01.842400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.850627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447a12c-5b08-44b8-8d95-b936d0ac3b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:01.851369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447a12c-5b08-44b8-8d95-b936d0ac3b08 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.851712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447a12c-5b08-44b8-8d95-b936d0ac3b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.851988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447a12c-5b08-44b8-8d95-b936d0ac3b08 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/4ed343e58e9d494aa4b303e5bf95b54e/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.853881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447a12c-5b08-44b8-8d95-b936d0ac3b08 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=4ed343e58e9d494aa4b303e5bf95b54e, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:01.855318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447a12c-5b08-44b8-8d95-b936d0ac3b08 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:01.876376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 406/805] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:27:01 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/4ed343e58e9d494aa4b303e5bf95b54e/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:27:01.876376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e72c6-5b5b-4366-b9eb-35ad06cf59fe None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:01.876376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e72c6-5b5b-4366-b9eb-35ad06cf59fe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:01.876376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e72c6-5b5b-4366-b9eb-35ad06cf59fe None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:01.876376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 407/806] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:01.876376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e72c6-5b5b-4366-b9eb-35ad06cf59fe None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:01.972944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:01.981802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaca63-9169-435d-9b58-a4dd458a4a07 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.022752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd346b4-080b-4486-8c27-2b0b435166a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.023500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd346b4-080b-4486-8c27-2b0b435166a0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.023808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd346b4-080b-4486-8c27-2b0b435166a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.024149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd346b4-080b-4486-8c27-2b0b435166a0 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.024904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd346b4-080b-4486-8c27-2b0b435166a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:02.025209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd346b4-080b-4486-8c27-2b0b435166a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.026851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd346b4-080b-4486-8c27-2b0b435166a0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.049944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 400/807] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:27:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:02.051701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb2f6-e177-429b-956c-54920ed799b7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.052147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb2f6-e177-429b-956c-54920ed799b7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.052424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb2f6-e177-429b-956c-54920ed799b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.071277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-54bbb2f6-e177-429b-956c-54920ed799b7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:02.072436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-54bbb2f6-e177-429b-956c-54920ed799b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:02.076114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:02.115953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e72c6-5b5b-4366-b9eb-35ad06cf59fe None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.147351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 401/808] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:02.148530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb2f6-e177-429b-956c-54920ed799b7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.170375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.171845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.172503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.172979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.174224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:02.174971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.176822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.183847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 408/809] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 16:27:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:02.185343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.249068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:02.267909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb2f6-e177-429b-956c-54920ed799b7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.308269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.309215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.309663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.310136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c8f28-8b48-41fe-beac-e1aa998848d5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.310247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.324660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:02.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:02.332090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:27:02.333110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:02.338472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 402/810] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:02.338472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.348891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:02.360057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.360772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.361804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.361804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.440400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.441882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.464274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f5ef-835a-4d60-bb35-9c68ca142c68 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.500439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.501057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.501339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.501613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.502250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:02.502555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.504306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.509264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 403/811] 10.222.0.88 () {56 vars in 1124 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:02.510061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.523485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:02.564027 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 409/812] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:02.565046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.595703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:02.615183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311df06-7068-429b-be4d-1f218e6a1ad8 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.650049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.650662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.650929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.651220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.651906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:02.652212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.653595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.661384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 404/813] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:02.662152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.681523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4e9a-ab20-4a20-8f32-55e09b5d96ea None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.718594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.719753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.720030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.720301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.720883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.722489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:02.732444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:02.733426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:27:02.734288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:02.735021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:02.735883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 410/814] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:02.735883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.774720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951f2d4-7a59-45bd-9363-ca611be5b1a2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.811446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.812115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.812405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.812671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.813353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.814727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.838870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 405/815] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:02.840716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.843270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:02.860305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5dabb-1ff8-45f0-b0d5-01378ce168d8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:02.917903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:02.918963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:02.919342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:02.919742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:02.936384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:02.939114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:02.956029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:02.957252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:02.958373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:02.958373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:02.958373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:02.964583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 411/816] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:02.965571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:02.980082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5321b2-db14-4b9a-85af-613609c9279d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.015909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:03.027147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.027820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.028101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.028376 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.041973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.043435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:03.059167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:03.060204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:03.061568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:03.061568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:03.061568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:03.061568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 406/817] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:03.061568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.075260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ba8e9-7788-43bf-99b3-6beab5f11b50 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.112721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.113254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.113524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.113786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.114409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] RBAC: Adding query filter params (name=network) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:03.114706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.116368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.121511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 412/818] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:03.122174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.135504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:03.190863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a68fd9-5bc0-4fb7-a6ba-fb42a70deed7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.239366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.240262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.240834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.241428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.242327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:03.242768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.244327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.245372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70913b-eebe-4bc3-9797-90726a52f14a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.258681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 407/819] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:03.260020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.284084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.284803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.285213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.285533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.286252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:03.286619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.288537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.310451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:03.318819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 413/820] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:03.318819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.374827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb29f1-dcdd-41aa-ae79-617d355b4ec5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.387852 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:03.414874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.415827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.416250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.416680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.417463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:03.417909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.419534 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.425555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 408/821] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:03.426563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.435316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9408d7-a923-4ca8-b848-340a0aa08e33 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.484003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.484809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.485160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.485518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.494518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.496672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:03.512666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:03.513777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:03.514917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:03.519653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 414/822] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:03.520787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.564448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a6bbf-463c-4a7d-b527-52f099525cc4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.566303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:03.617303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.618865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.619152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.619426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.629340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.631024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:03.646123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:03.647317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:03.648393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:03.651656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 409/823] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:03.653618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.660340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfda97-f312-43b1-8721-5bf437d85928 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.694310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:03.709230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.710157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.710550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.710915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.712159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.714020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.744996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 415/824] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:03.746339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.784154 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8dca6-3210-405a-bb8e-68a283fd9f3c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.832205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fd92d-4362-4191-97fd-9a3f70f000ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.833221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd92d-4362-4191-97fd-9a3f70f000ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.833857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd92d-4362-4191-97fd-9a3f70f000ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.834513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd92d-4362-4191-97fd-9a3f70f000ce None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.835405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fd92d-4362-4191-97fd-9a3f70f000ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:03.835931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fd92d-4362-4191-97fd-9a3f70f000ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.837748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fd92d-4362-4191-97fd-9a3f70f000ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.851749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 410/825] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:03.853135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605bdc1-38e6-4161-9293-89dd8427e7ff None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.853420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605bdc1-38e6-4161-9293-89dd8427e7ff None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.853699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605bdc1-38e6-4161-9293-89dd8427e7ff None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.855236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 411/826] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:03.860958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605bdc1-38e6-4161-9293-89dd8427e7ff None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:03.886313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:03.894715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0bca9-3771-413b-875e-aab89d455070 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:03.938295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1aa1-25e4-4539-81b1-7759e60fe834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:03.939030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1aa1-25e4-4539-81b1-7759e60fe834 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.939377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1aa1-25e4-4539-81b1-7759e60fe834 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.939793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1aa1-25e4-4539-81b1-7759e60fe834 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.940649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1aa1-25e4-4539-81b1-7759e60fe834 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:03.940966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1aa1-25e4-4539-81b1-7759e60fe834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:03.942444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1aa1-25e4-4539-81b1-7759e60fe834 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:03.965887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 416/827] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:03.967133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753163-f069-4c43-af27-77951e6b400d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:03.967421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753163-f069-4c43-af27-77951e6b400d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:03.967758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2753163-f069-4c43-af27-77951e6b400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:03.986964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f2753163-f069-4c43-af27-77951e6b400d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:03.988191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f2753163-f069-4c43-af27-77951e6b400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:04.013297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605bdc1-38e6-4161-9293-89dd8427e7ff None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.027472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:04.061226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.062098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.062550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.062962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.063881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f928809858b64247862a3901925f8a43, user.id=ff19f92d804245ba908c5609bd133ca2) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:04.064333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:04.065915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:04.066459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 417/828] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:04.067302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753163-f069-4c43-af27-77951e6b400d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.073720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 412/829] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:03 2022] GET /identity/v3/role_assignments?user.id=ff19f92d804245ba908c5609bd133ca2&scope.project.id=f928809858b64247862a3901925f8a43&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:04.179991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2753163-f069-4c43-af27-77951e6b400d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.217681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.218329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.218604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.218868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.229853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:04.231331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:04.246541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:04.247723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:04.248969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:04.248969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:04.248969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:04.248969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 418/830] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:04.255643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.343969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.351217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:04.369823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:04.379373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78c075-3745-4282-943e-53bc008b6d18 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.426770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.427799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.428757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.429269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.430182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:04.431119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:04.433389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:04.449895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 413/831] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:04.456120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.466426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03621acf-eff8-4bcf-9cd1-1e2a5cb2e31c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.511748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.513009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.513791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.514255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.528460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:04.535646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:04.536667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:04.537539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:04.541017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 419/832] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:04.548175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.576071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01814a2c-62d0-41ba-8343-a97bed08f481 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.614777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.615570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.616067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.616431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.624428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:04.626218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:04.638780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:04.639803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:04.640715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:04.645650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 414/833] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:04.646895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.649836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:04.650227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:04.674633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f638a-f5da-4384-8fe1-40c16116b436 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.718658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.719867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.720317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.720900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.722022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:04.722696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:04.724329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:04.737215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 420/834] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:04.743038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.772991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3df9-4ec8-459a-ab33-0e3ec30c5a15 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.818684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.819369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.819632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.819877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.820568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:04.820868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:04.822826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:04.843616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 415/835] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:04.845936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.876567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497701a-7545-4ecd-9261-3807d97087b7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:04.912869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:04.913324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:04.913563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:04.913779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:04.914049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:04.926009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:04.926980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:04.928836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:04.942602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:04.943622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:04.944735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:04.944735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:04.944735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:04.949785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 421/836] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:04.950649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:04.964552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef8c3a-e8c0-4513-8a42-e0e4d955e9ca None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.001507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab14a8e-c6b2-41d1-a759-da4922c5ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.002523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab14a8e-c6b2-41d1-a759-da4922c5ca02 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.003364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab14a8e-c6b2-41d1-a759-da4922c5ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.003910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab14a8e-c6b2-41d1-a759-da4922c5ca02 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/809566003ec643fe82727431941fe3ce/roles/8bece968e0a344968a91eab1247ced88` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.019920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab14a8e-c6b2-41d1-a759-da4922c5ca02 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=809566003ec643fe82727431941fe3ce, role_id=8bece968e0a344968a91eab1247ced88)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.021648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab14a8e-c6b2-41d1-a759-da4922c5ca02 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.042630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 416/837] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:27:04 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/809566003ec643fe82727431941fe3ce/roles/8bece968e0a344968a91eab1247ced88 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:27:05.044855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c427-aa3a-421b-962b-17859636ccdf None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.045135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c427-aa3a-421b-962b-17859636ccdf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.045406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c427-aa3a-421b-962b-17859636ccdf None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.047493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 417/838] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:05.053348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaba59-dd8a-40c3-9b20-bbdd56f25270 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.053621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaba59-dd8a-40c3-9b20-bbdd56f25270 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.053906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaba59-dd8a-40c3-9b20-bbdd56f25270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.064680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496bd5b-3433-4749-9076-39661a872783 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.077677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8eeaba59-dd8a-40c3-9b20-bbdd56f25270 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:05.079227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8eeaba59-dd8a-40c3-9b20-bbdd56f25270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:05.116826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.118037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.118326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.118604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.119538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:05.119882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.121643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.144500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 422/839] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:05.145775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:05.174269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 418/840] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:05.211016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:05.261255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc8293-128a-4c22-bd4a-7528d06b4b07 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.296733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.297497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.297776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.298040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.306067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.307558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:05.319762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:05.320999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:05.322286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 423/841] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:27:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:05.327085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaba59-dd8a-40c3-9b20-bbdd56f25270 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:05.372919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:05.432114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaba59-dd8a-40c3-9b20-bbdd56f25270 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.451907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:05.470937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.471836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.472120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.472392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.473602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:05.473919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.475691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.499400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 419/842] 10.222.0.88 () {56 vars in 1135 bytes} [Wed Aug 24 16:27:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:05.508642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:05.581161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183e58d-d7ca-4670-b6a2-1720a50dd8a2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.604295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:05.639465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.640754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.641634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:05.642051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.643359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.644261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.645500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def56c4-4c34-46ef-bd18-c7f8bc03845a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.646349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:05.658988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:05.660276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:05.661344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:05.669910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 424/843] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:05.671803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:05.693324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.694101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.694379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.694647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.766101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.767597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.785917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ca9d5-03f0-4ddf-b898-7ef008009e21 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.821411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.822408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.822901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.823363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.824239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:05.824734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.826311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.836092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 425/844] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:05.837587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:05.868539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:05.873285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 420/845] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:05.879197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:05.884105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:05.942959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4d72f-65f5-469e-801c-30ba49cb3a26 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.978203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:05.979204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:05.979728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:05.980210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:05.981035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:05.981530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:05.983189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:05.995604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0be7-2fd6-4291-9757-52ac6a191656 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:05.995988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 426/846] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:06.034762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae05e3-887c-46d5-bd63-2560d34fc7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:06.035844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae05e3-887c-46d5-bd63-2560d34fc7fa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.036370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae05e3-887c-46d5-bd63-2560d34fc7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.036836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae05e3-887c-46d5-bd63-2560d34fc7fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.049238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae05e3-887c-46d5-bd63-2560d34fc7fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:06.051144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae05e3-887c-46d5-bd63-2560d34fc7fa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-63ae05e3-887c-46d5-bd63-2560d34fc7fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:06.068134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:06.069229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:06.070148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:06.070148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:06.070148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:06.072496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 421/847] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:06.080836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:06.091642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35bc9b-5b97-4e20-ab87-a4fba6e7c4d0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.091840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35bc9b-5b97-4e20-ab87-a4fba6e7c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.092106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35bc9b-5b97-4e20-ab87-a4fba6e7c4d0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.093714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 422/848] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:06.099032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df9b4-eb94-418c-8bb0-ee65d7745c5c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.099316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df9b4-eb94-418c-8bb0-ee65d7745c5c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.099606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9df9b4-eb94-418c-8bb0-ee65d7745c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.119430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3f9df9b4-eb94-418c-8bb0-ee65d7745c5c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:06.120709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3f9df9b4-eb94-418c-8bb0-ee65d7745c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:06.179002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:06.209670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 423/849] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:06.219592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7624149-27d2-462d-bab0-d3a212f17b82 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:06.227464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:06.257228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:06.258034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.258408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.258773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.259539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:06.259955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:06.261478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:06.274330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 427/850] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:06.280158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9df9b4-eb94-418c-8bb0-ee65d7745c5c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:06.390184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9df9b4-eb94-418c-8bb0-ee65d7745c5c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:06.424744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:06.425379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.425653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.425920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.433209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:06.434671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:06.446479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:06.447401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:06.448299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 424/851] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:06.453854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:06.495227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:06.555976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:06.560849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136990b-b369-4bff-9d82-5ab5f2025d87 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:06.599466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:06.600664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.601137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.601622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.602505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:06.603052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:06.604705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:06.620376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 428/852] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:06.626544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:06.634240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4a96a-a423-4770-ad65-ea89130ccd20 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:06.656612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:06.670527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:06.671389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.671711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.671981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.672648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:06.674148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:06.684053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:06.685036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:06.685921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 425/853] 10.222.0.88 () {56 vars in 1132 bytes} [Wed Aug 24 16:27:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:06.692007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:06.742137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cdc14-4c09-4353-a84b-353a2b8c3f83 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:06.777335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:06.778170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.778588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.778993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.779953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f928809858b64247862a3901925f8a43, user.id=4ed343e58e9d494aa4b303e5bf95b54e) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:06.780436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:06.782057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:06.794819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 429/854] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:06 2022] GET /identity/v3/role_assignments?user.id=4ed343e58e9d494aa4b303e5bf95b54e&scope.project.id=f928809858b64247862a3901925f8a43&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:06.797279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b26003-e754-48ae-bff5-f1e013d150ce None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:06.807709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:06.838804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd238a73-6b3e-408c-a08b-5223eab92790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:06.839638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238a73-6b3e-408c-a08b-5223eab92790 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:06.840015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238a73-6b3e-408c-a08b-5223eab92790 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:06.840373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd238a73-6b3e-408c-a08b-5223eab92790 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:06.841113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd238a73-6b3e-408c-a08b-5223eab92790 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:06.841509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd238a73-6b3e-408c-a08b-5223eab92790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:06.843273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd238a73-6b3e-408c-a08b-5223eab92790 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:06.849045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 426/855] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:06.855113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:06.958468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:06.969523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8311f8a-ebd7-46e8-9981-f21e468e9ab5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:07.008258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028192-dcbb-4ec2-a1c0-6d18ed0d7f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:07.008882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028192-dcbb-4ec2-a1c0-6d18ed0d7f14 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:07.009157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028192-dcbb-4ec2-a1c0-6d18ed0d7f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:07.009425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028192-dcbb-4ec2-a1c0-6d18ed0d7f14 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:07.010063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028192-dcbb-4ec2-a1c0-6d18ed0d7f14 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:07.010364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028192-dcbb-4ec2-a1c0-6d18ed0d7f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:07.013766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028192-dcbb-4ec2-a1c0-6d18ed0d7f14 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:07.017133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 430/856] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:07.034583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4a51-c129-4eb4-96aa-8bcc6ad43485 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:07.035134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4a51-c129-4eb4-96aa-8bcc6ad43485 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:07.035134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb4a51-c129-4eb4-96aa-8bcc6ad43485 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:07.036531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 427/857] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:07.043411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bcf1-a86a-44e7-af45-bc85a32eb417 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:07.043775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bcf1-a86a-44e7-af45-bc85a32eb417 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:07.044009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bcf1-a86a-44e7-af45-bc85a32eb417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:07.066040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-29a5bcf1-a86a-44e7-af45-bc85a32eb417 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:07.067739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-29a5bcf1-a86a-44e7-af45-bc85a32eb417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:07.151907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 431/858] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:07.415159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb4a51-c129-4eb4-96aa-8bcc6ad43485 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:07.526983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb4a51-c129-4eb4-96aa-8bcc6ad43485 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:07.563769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:07.564324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:07.564602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:07.564869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:07.575394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:07.580054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:07.580987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:27:07.581808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:07.586511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 428/859] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:07.588702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5bcf1-a86a-44e7-af45-bc85a32eb417 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:07.681792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:07.700738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5bcf1-a86a-44e7-af45-bc85a32eb417 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:07.735857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:07.736468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:07.736742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:07.737008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:07.737673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:07.737969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:07.739346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:07.748426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 432/860] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:07.754207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:07.790354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:07.863648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72652071-9c25-4901-baa5-b3f2c85e906e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:07.906571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed63de7-5090-4689-953d-0146d10e87ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:07.907220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed63de7-5090-4689-953d-0146d10e87ac None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:07.907553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed63de7-5090-4689-953d-0146d10e87ac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:07.907863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed63de7-5090-4689-953d-0146d10e87ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:07.926574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed63de7-5090-4689-953d-0146d10e87ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:07.928094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed63de7-5090-4689-953d-0146d10e87ac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-2ed63de7-5090-4689-953d-0146d10e87ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:07.952126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:07.954303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:07.956359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:07.956359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:07.956359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:07.958633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 429/861] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:07.959750 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:08.052609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb2c81-c9b2-4f2e-b1c7-47036e3d2bee None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:08.053582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb2c81-c9b2-4f2e-b1c7-47036e3d2bee None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:08.053582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb2c81-c9b2-4f2e-b1c7-47036e3d2bee None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:08.055180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 430/862] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:08.062521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81d84-c1ba-4a83-be18-619b3ed56213 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:08.062859 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81d84-c1ba-4a83-be18-619b3ed56213 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:08.063135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81d84-c1ba-4a83-be18-619b3ed56213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:08.087676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-45a81d84-c1ba-4a83-be18-619b3ed56213 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:08.088901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-45a81d84-c1ba-4a83-be18-619b3ed56213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:08.101933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d03f-8fdc-49c1-95e8-ae88edbc6355 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:08.168978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:08.169466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:08.169744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:08.170166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:08.172024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:08.172468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:08.176241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:08.192308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 433/863] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:08.199122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:08.201989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 431/864] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:08.211277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:08.323488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83022eeb-e615-4adf-a784-4b961adf1182 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:08.365399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:08.366944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:08.367441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:08.368061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:08.377395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:08.379530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:08.393906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:08.394876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:08.395859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:08.403387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 434/865] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:27:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:08.405244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81d84-c1ba-4a83-be18-619b3ed56213 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:08.433362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:08.543066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81d84-c1ba-4a83-be18-619b3ed56213 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:08.583743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:08.584886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:08.586258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:08.586971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:08.588375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:08.589365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:08.589875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:08.591633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:08.619166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 432/866] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 16:27:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:08.624862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:08.678634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:08.734639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0017d-a7e4-4ce9-9027-6b4ec6f9b84d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:08.741148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:08.776811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcab42-0b61-41d0-81e8-9f17ecd9a048 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:08.785933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43432e73-f106-4717-a7e0-c1951b0800a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:08.786561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432e73-f106-4717-a7e0-c1951b0800a0 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:08.786843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432e73-f106-4717-a7e0-c1951b0800a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:08.787119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432e73-f106-4717-a7e0-c1951b0800a0 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:08.789251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43432e73-f106-4717-a7e0-c1951b0800a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:08.790668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43432e73-f106-4717-a7e0-c1951b0800a0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:08.815817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 435/867] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:27:08 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:27:08.846728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:08.847373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:08.847734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:08.848017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:08.929923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:08.931401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.000621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85bc4f-ec2c-463a-8e75-d7f4da9d3a79 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.000815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85bc4f-ec2c-463a-8e75-d7f4da9d3a79 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.001080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85bc4f-ec2c-463a-8e75-d7f4da9d3a79 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.002703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 436/868] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:09.005404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:09.010763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434387a-2d61-4e97-87b5-7d9d89a1edf4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.011039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434387a-2d61-4e97-87b5-7d9d89a1edf4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.011470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434387a-2d61-4e97-87b5-7d9d89a1edf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.038625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9434387a-2d61-4e97-87b5-7d9d89a1edf4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:09.041125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9434387a-2d61-4e97-87b5-7d9d89a1edf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:09.047244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 433/869] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:08 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:09.054212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.127850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 437/870] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:09.131676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530b68-1517-4528-b6f6-37e4ea70dcbe None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.131676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530b68-1517-4528-b6f6-37e4ea70dcbe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.131676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530b68-1517-4528-b6f6-37e4ea70dcbe None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.131676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 438/871] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:09.138002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad91dd-ecc2-4956-b88a-9b67417ceaa3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.138515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad91dd-ecc2-4956-b88a-9b67417ceaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.138961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad91dd-ecc2-4956-b88a-9b67417ceaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.161724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f7ad91dd-ecc2-4956-b88a-9b67417ceaa3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:09.163348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f7ad91dd-ecc2-4956-b88a-9b67417ceaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:09.178069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b5728-b8b3-4421-be59-500dfea9fa8d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.218205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.218837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.219110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.219379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.230689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.231642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:09.233616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:09.252958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:09.254291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:09.255204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:09.255204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:09.255204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:09.257413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 434/872] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:09.257843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 439/873] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:09.262788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.291661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:09.370685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc7e45-9eec-4259-8097-28c17f07ed40 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.402527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad91dd-ecc2-4956-b88a-9b67417ceaa3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.408795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.409415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.409694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.409973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.410622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:09.410924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.412331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.427633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 435/874] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:09.433095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.519522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:09.532452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad91dd-ecc2-4956-b88a-9b67417ceaa3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.544454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec31fb-4641-4a53-8c1e-1b2c7a135855 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.568301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.568997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.569279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.569774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.570128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.571510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.580196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:09.580347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:09.581268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:09.585001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:09.585918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.585918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.585918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.586237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 440/875] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:09.586237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.593331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.594768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:09.606290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:09.607194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:09.608139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 436/876] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:09.608650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.654294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:09.710953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a32ef-81b6-4c26-802f-8e8fb6b66ce1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.715243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c593f-9cc4-448c-a6cf-ce904e54d1ed None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.748260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.748868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.749145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.749409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.750048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.751108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.751424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.751755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.752037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.752309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.752937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:09.753584 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.754934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.760482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 437/877] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:09.761279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.764043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:09.774186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 441/878] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:27:09 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:09.784732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.884727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c99a59-0d88-4c5a-b6b9-4cc0acacfaa0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.942656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af771ba-0994-48d1-a48f-f57727d5b67d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:09.947506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.948231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.948508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.948777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.949465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:09.949772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.950622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:09.951209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.967826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 438/879] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:09.972023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:09.989276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f90d1a-9729-44ee-a0af-db34aa94d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:09.989927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90d1a-9729-44ee-a0af-db34aa94d2dd None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:09.990210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90d1a-9729-44ee-a0af-db34aa94d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:09.990685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f90d1a-9729-44ee-a0af-db34aa94d2dd None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:09.991571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f90d1a-9729-44ee-a0af-db34aa94d2dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:09.991919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f90d1a-9729-44ee-a0af-db34aa94d2dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:09.993356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f90d1a-9729-44ee-a0af-db34aa94d2dd None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:09.999596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 442/880] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:10.051686 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:10.104017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9add-31cb-421e-8c14-dc6e77be8e23 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:10.148114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0d0b-0aae-43d0-b6eb-59e747234e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:10.148735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0d0b-0aae-43d0-b6eb-59e747234e40 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:10.149018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0d0b-0aae-43d0-b6eb-59e747234e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:10.149292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0d0b-0aae-43d0-b6eb-59e747234e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:10.150033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0d0b-0aae-43d0-b6eb-59e747234e40 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=809566003ec643fe82727431941fe3ce) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:10.150340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0d0b-0aae-43d0-b6eb-59e747234e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:10.151814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0d0b-0aae-43d0-b6eb-59e747234e40 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:10.159672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 439/881] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:09 2022] GET /identity/v3/role_assignments?user.id=809566003ec643fe82727431941fe3ce&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:10.831954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771df60-b3d5-4fd0-a4c7-c66f42b18891 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:10.832796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771df60-b3d5-4fd0-a4c7-c66f42b18891 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:10.833230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771df60-b3d5-4fd0-a4c7-c66f42b18891 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:10.835028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 443/882] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:10.840992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aacd6b-3050-452f-ae4b-d464f33178d5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:10.841551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aacd6b-3050-452f-ae4b-d464f33178d5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:10.842018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aacd6b-3050-452f-ae4b-d464f33178d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:10.860529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f4aacd6b-3050-452f-ae4b-d464f33178d5 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:10.862062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f4aacd6b-3050-452f-ae4b-d464f33178d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:10.930226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 440/883] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:11.194696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771df60-b3d5-4fd0-a4c7-c66f42b18891 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:11.311750 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771df60-b3d5-4fd0-a4c7-c66f42b18891 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:11.353022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:11.353685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.353962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.354249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:11.354822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:11.356289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:11.366001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:11.367202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:11.368065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 444/884] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:11.375189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aacd6b-3050-452f-ae4b-d464f33178d5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:11.433741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:11.482842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aacd6b-3050-452f-ae4b-d464f33178d5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:11.517709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:11.518320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.518601 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.518859 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:11.519485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:11.519811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:11.521172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:11.526329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 441/885] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:11.531933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:11.568986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:11.637349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae83fd-b8aa-444d-935d-60dfad51872c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:11.675173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e1d33-eb23-4382-b2c9-1de51a21932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:11.676216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e1d33-eb23-4382-b2c9-1de51a21932d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.676688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e1d33-eb23-4382-b2c9-1de51a21932d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.677147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e1d33-eb23-4382-b2c9-1de51a21932d None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:11.677959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e1d33-eb23-4382-b2c9-1de51a21932d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:11.678610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e1d33-eb23-4382-b2c9-1de51a21932d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:11.680210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e1d33-eb23-4382-b2c9-1de51a21932d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:11.685704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 445/886] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:11.691758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:11.793046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e772a-58d5-4f37-8eb4-af993c656095 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:11.801197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c3bd-186f-4e2e-87ea-c11eec40f20e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.801476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c3bd-186f-4e2e-87ea-c11eec40f20e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.801746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c3bd-186f-4e2e-87ea-c11eec40f20e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:11.803390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 446/887] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:11.808888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8b370-18ee-476e-81c8-d10c39e07efe None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.809282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8b370-18ee-476e-81c8-d10c39e07efe None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.809645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8b370-18ee-476e-81c8-d10c39e07efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:11.819940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:11.830520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-92f8b370-18ee-476e-81c8-d10c39e07efe None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:11.831888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-92f8b370-18ee-476e-81c8-d10c39e07efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:11.835018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:11.836081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.836081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.836343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:11.837047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] RBAC: Adding query filter params (interface=public, service_id=03dd1155e7df41f2b6f6a53943797813, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:11.837357 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:11.838746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:11.844978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 442/888] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:27:11 2022] GET /identity/v3/endpoints?service_id=03dd1155e7df41f2b6f6a53943797813&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:11.854085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:11.926248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 447/889] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:11.974368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a71942-e8bf-401a-a70d-d49e144c588f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:11.983782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e2f49-7894-4386-8be0-69cf826fcb71 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.984060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e2f49-7894-4386-8be0-69cf826fcb71 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.984342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e2f49-7894-4386-8be0-69cf826fcb71 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:11.985930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 448/890] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:11.991130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49c844-c145-4e0c-a58b-f6592f70911b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:11.991410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49c844-c145-4e0c-a58b-f6592f70911b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:11.991882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49c844-c145-4e0c-a58b-f6592f70911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.011127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7b49c844-c145-4e0c-a58b-f6592f70911b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:12.012604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7b49c844-c145-4e0c-a58b-f6592f70911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:12.015710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.017491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.017984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.018444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.019249 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:12.021347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:12.037651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 443/891] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:27:11 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:27:12.044598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:12.096829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 449/892] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:12.192850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.223762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16895de-470e-44e3-adae-daec3765d8d0 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.224076 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16895de-470e-44e3-adae-daec3765d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.224643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16895de-470e-44e3-adae-daec3765d8d0 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.226057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 450/893] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:12.231154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba94e-c967-4364-ae9e-69cc1df5bb6a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.231431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba94e-c967-4364-ae9e-69cc1df5bb6a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.231751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba94e-c967-4364-ae9e-69cc1df5bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.250497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:12.254328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f25ba94e-c967-4364-ae9e-69cc1df5bb6a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:12.256431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f25ba94e-c967-4364-ae9e-69cc1df5bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:12.320463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a88452-46c9-41fa-87a2-7bd9355e620a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:12.340813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 451/894] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:12.358717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.359738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.360266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.360748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.361590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:12.363237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:12.373264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:12.374207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:12.375109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:12.377964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba94e-c967-4364-ae9e-69cc1df5bb6a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.383600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 444/895] 10.222.0.88 () {56 vars in 1132 bytes} [Wed Aug 24 16:27:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:12.388559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.468135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:12.481447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba94e-c967-4364-ae9e-69cc1df5bb6a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:12.504175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab86f8-c6fd-420f-96cb-778f52d50831 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:12.517299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.517917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.518193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.518461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.519479 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:12.521073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:12.522211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:12.541368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 452/896] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:27:12 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:12.564131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.564679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.564961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.565282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.565939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:12.566245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:12.567792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:12.574811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 445/897] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:12.581117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.617195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.733798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49236bf3-5e26-435b-8f3d-f463f8b98c9f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:12.750385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15726-3d24-4cb4-80f5-f82f5f07ce80 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:12.769357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.770074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.770353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.770624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.771259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:12.771559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:12.773373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:12.779055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 453/898] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:12.787442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.788503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.788641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.788806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.791480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.802278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:12.808606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:12.809546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:12.810386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 446/899] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 16:27:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:12.815540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:12.816975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.854098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:12.933765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff477-98f0-47c0-9f0c-3812aa800a4d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:12.942571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84a88f-091b-4580-929b-504bed606572 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:12.969675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.970381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.970724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.971060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.971831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:12.972213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:12.973645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:12.986726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 447/900] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 16:27:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:12.988261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:12.993968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:12.994598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:12.994882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:12.995157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:12.995906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] RBAC: Adding query filter params (interface=public, service_id=f39c0ed195e247f5bf726613447e19e1, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:12.996218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:12.997598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:13.011664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 454/901] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:27:12 2022] GET /identity/v3/endpoints?service_id=f39c0ed195e247f5bf726613447e19e1&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:13.014856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:13.094936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:13.105943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483df5df-336d-4a35-ae62-ed168050960e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:13.109726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:13.137753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42197-33e3-4a4f-b09f-3776df933764 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:13.141418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:13.142198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:13.142577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:13.142950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:13.154572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:13.156254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:13.172804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:13.174216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:13.175321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:13.175321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:13.175321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:13.176799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 448/902] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:13.181908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:13.191427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:13.192413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:13.193334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:13.193837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:13.195279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:13.197522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:13.206288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 455/903] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:27:13 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:27:13.355896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a4c9e-9967-4217-8352-486c48a44b5c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:13.393452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:13.394085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:13.394325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:13.394593 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:13.395242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:13.395543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:13.396970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:13.410143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 449/904] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:13.416722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:13.526114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228332-db5c-4149-bb56-6c4bcaf30a82 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:13.561528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:13.562516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:13.562999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:13.563471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:13.571705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:13.573402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:13.576283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:13.587433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:13.588432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:13.589373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:13.591740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 456/905] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:27:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:13.597721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:13.600901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:13.709106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98909a6-cc56-499b-acb8-71d0249100be None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:13.746124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d5ce9-b06c-4b6e-9b16-548b01ab4fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:13.747125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5ce9-b06c-4b6e-9b16-548b01ab4fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:13.747548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5ce9-b06c-4b6e-9b16-548b01ab4fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:13.747981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5ce9-b06c-4b6e-9b16-548b01ab4fd7 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:13.748880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d5ce9-b06c-4b6e-9b16-548b01ab4fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:13.749330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d5ce9-b06c-4b6e-9b16-548b01ab4fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:13.750971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d5ce9-b06c-4b6e-9b16-548b01ab4fd7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:13.771285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 450/906] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 16:27:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:13.777518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:13.887113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1e6e2-ca0c-41fc-8904-57c5dd485b8f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:13.922513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:13.923398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:13.923842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:13.924248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:13.993587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:13.997273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:13.999203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:14.057414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59258d43-6ec3-428a-9b07-c731e9fc88db None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.057685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59258d43-6ec3-428a-9b07-c731e9fc88db None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.058051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59258d43-6ec3-428a-9b07-c731e9fc88db None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.059563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 451/907] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:14.064798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514535-7a44-4cea-a369-f3e84ff5b3cc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.065077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514535-7a44-4cea-a369-f3e84ff5b3cc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.065348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514535-7a44-4cea-a369-f3e84ff5b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.085355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-83514535-7a44-4cea-a369-f3e84ff5b3cc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:14.086644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-83514535-7a44-4cea-a369-f3e84ff5b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:14.111020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 457/908] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:13 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:14.116841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.148139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:14.161956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 452/909] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:14.217343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:14.220158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b4de6-b691-4fec-91f2-fe2a2bd12343 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:14.255463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:14.256047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.256322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.256637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.267219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:14.268709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:14.283633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:14.284600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:14.285493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:14.285493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:14.285493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:14.285493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 458/910] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:14.290723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514535-7a44-4cea-a369-f3e84ff5b3cc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.411891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514535-7a44-4cea-a369-f3e84ff5b3cc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:14.449432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:14.450435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.450926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.451381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.452233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:14.452736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:14.454298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:14.464118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.467837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 453/911] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:14.477977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.537373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:14.592836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6d213-e68e-499e-b93b-540469feb0a6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:14.596277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a86cb1-8f2b-4875-bffb-ee404f7d95aa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:14.631743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69c3e-6533-4c35-afaf-0b5a454e6994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:14.632545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69c3e-6533-4c35-afaf-0b5a454e6994 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.632648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:14.632839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69c3e-6533-4c35-afaf-0b5a454e6994 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.633082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69c3e-6533-4c35-afaf-0b5a454e6994 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.633234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.633484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.633665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69c3e-6533-4c35-afaf-0b5a454e6994 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:14.633755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.635040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69c3e-6533-4c35-afaf-0b5a454e6994 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:14.640811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:14.642231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4bf69c3e-6533-4c35-afaf-0b5a454e6994 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:14.643783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:14.644953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:14.645772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 459/912] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:14.646552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481ae79-61fa-486f-b94d-b00987630c1e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.646552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481ae79-61fa-486f-b94d-b00987630c1e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.646671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481ae79-61fa-486f-b94d-b00987630c1e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.648306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 460/913] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:14.654644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e79b-9419-4bbc-bfd9-bf6149ef9453 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.654922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e79b-9419-4bbc-bfd9-bf6149ef9453 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.655194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e79b-9419-4bbc-bfd9-bf6149ef9453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:14.657959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:14.659072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 454/914] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:14.660467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.679259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5bc2e79b-9419-4bbc-bfd9-bf6149ef9453 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:14.680505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5bc2e79b-9419-4bbc-bfd9-bf6149ef9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:14.692537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:14.752894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 461/915] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:14.754360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e79b-9419-4bbc-bfd9-bf6149ef9453 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.784629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d423f70-c8e6-4011-965a-1d1549377bbb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:14.796294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:14.823606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:14.824345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.825067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.825405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.826369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:14.826733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:14.828831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:14.839726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 455/916] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:14.842060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.887096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e79b-9419-4bbc-bfd9-bf6149ef9453 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:14.945982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:14.946636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:14.946916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:14.947197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:14.948190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:14.948497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:14.950742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:14.971326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 462/917] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:14.972507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:14.974124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b2c52-1c8c-4fb6-bc0e-04e63b200961 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:14.982632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:15.029662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.030524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.030975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.031256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.031928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:15.032538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.034336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.045068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 456/918] 10.222.0.88 () {56 vars in 1114 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:15.045068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.083541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:15.090397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34366a-cdca-4617-8b1b-415f29c360a0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.126337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.126931 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.127210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.127476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.128563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] RBAC: Adding query filter params (role.id=1bff325fd3c94f1ea4e01a5cc670b874, scope.project.id=f928809858b64247862a3901925f8a43, user.id=809566003ec643fe82727431941fe3ce) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:15.128869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.130296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.135933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 463/919] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:14 2022] GET /identity/v3/role_assignments?user.id=809566003ec643fe82727431941fe3ce&scope.project.id=f928809858b64247862a3901925f8a43&role.id=1bff325fd3c94f1ea4e01a5cc670b874 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:15.144786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.154050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75546b7-9c5c-46ac-80bf-259b17a83301 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.194368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23767c-2402-4076-8112-10bee526158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.195470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23767c-2402-4076-8112-10bee526158c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.195790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23767c-2402-4076-8112-10bee526158c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.196069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23767c-2402-4076-8112-10bee526158c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.196685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23767c-2402-4076-8112-10bee526158c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.198260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23767c-2402-4076-8112-10bee526158c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4d23767c-2402-4076-8112-10bee526158c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:15.208122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:15.209188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:15.216318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 457/920] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:15.217101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23767c-2402-4076-8112-10bee526158c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.238872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:15.277423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090547cc-60fd-46e6-ad23-80ef5d811a6e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.315039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8884e-ac92-4936-9d53-afe3cb32717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.315677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8884e-ac92-4936-9d53-afe3cb32717e None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.315952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8884e-ac92-4936-9d53-afe3cb32717e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.316217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8884e-ac92-4936-9d53-afe3cb32717e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.316878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8884e-ac92-4936-9d53-afe3cb32717e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.318246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8884e-ac92-4936-9d53-afe3cb32717e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.340643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 464/921] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:15.341886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08936-608c-4d77-8619-354fbc83194c None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.342205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08936-608c-4d77-8619-354fbc83194c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.342476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08936-608c-4d77-8619-354fbc83194c None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.348649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 465/922] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:15.350378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199b85-ac2c-4879-9a2a-28a502ee2b7d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.350724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199b85-ac2c-4879-9a2a-28a502ee2b7d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.351032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199b85-ac2c-4879-9a2a-28a502ee2b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.364899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23767c-2402-4076-8112-10bee526158c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.367741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:15.385677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2a199b85-ac2c-4879-9a2a-28a502ee2b7d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:15.387153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2a199b85-ac2c-4879-9a2a-28a502ee2b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:15.419705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.421136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.421621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.422087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.422936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:15.423433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.425186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.431537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 458/923] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:15.444856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.480526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 466/924] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:15.563775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8da6d6-a7d1-4176-8be3-8687e5993595 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.599879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.600477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.600750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.601020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.601657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:15.601954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.603331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.608981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 459/925] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:15.614669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a199b85-ac2c-4879-9a2a-28a502ee2b7d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.674831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:15.721658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a199b85-ac2c-4879-9a2a-28a502ee2b7d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.757737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.759343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.759991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.760329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.760599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.761307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] RBAC: Adding query filter params (interface=public, service_id=33271406613844a4ba257c4b3dc1f9e3, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:15.761607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.762992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.771628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 467/926] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:27:15 2022] GET /identity/v3/endpoints?service_id=33271406613844a4ba257c4b3dc1f9e3&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:15.774940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.795873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:15.890863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c224a05-73d3-4ca4-9d81-d96b0aa2fd7d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.904552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542ca8-e086-4367-9bb8-d0732eedac6d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:15.928373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.929171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.929515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.929855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.930506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.931990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.939922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:15.941173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:15.942085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:27:15.942962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:15.948009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 460/927] 10.222.0.88 () {56 vars in 1132 bytes} [Wed Aug 24 16:27:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:15.948897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:15.954835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:15.955535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:15.955901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:15.956239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:15.956918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:15.958424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:15.971602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 468/928] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:27:15 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:27:16.061172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:16.072473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a69ba-3ade-4e0b-b452-65c1321313bf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:16.115378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:16.116463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:16.116949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:16.117450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:16.118310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:16.118868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:16.120519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:16.126483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 461/929] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:16.133081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:16.249677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff192-2fd7-44be-98c6-400c4a246956 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:16.285963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6fee-040a-4aab-96d0-178d98a8f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:16.286965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6fee-040a-4aab-96d0-178d98a8f9ad None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:16.287440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6fee-040a-4aab-96d0-178d98a8f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:16.288060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6fee-040a-4aab-96d0-178d98a8f9ad None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:16.288902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6fee-040a-4aab-96d0-178d98a8f9ad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:16.289403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6fee-040a-4aab-96d0-178d98a8f9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:16.290962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6fee-040a-4aab-96d0-178d98a8f9ad None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:16.296802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 469/930] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:16.305169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:16.420278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033da085-76aa-4c1b-9650-25cbb3f309b1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:16.458930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab09b-7d22-479c-96c3-7093c1723798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:16.459628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab09b-7d22-479c-96c3-7093c1723798 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:16.459921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab09b-7d22-479c-96c3-7093c1723798 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:16.460172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab09b-7d22-479c-96c3-7093c1723798 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:16.460843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab09b-7d22-479c-96c3-7093c1723798 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:16.462214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab09b-7d22-479c-96c3-7093c1723798 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:16.486703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 462/931] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:17.091715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf92e5-c7e1-4aa2-9e31-8ca2d5b678ba None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:17.092064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf92e5-c7e1-4aa2-9e31-8ca2d5b678ba None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:17.092276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf92e5-c7e1-4aa2-9e31-8ca2d5b678ba None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:17.093864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 470/932] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:17.099225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309966-4fc8-4f9d-ab71-241e3f4700bd None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:17.099517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309966-4fc8-4f9d-ab71-241e3f4700bd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:17.099862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa309966-4fc8-4f9d-ab71-241e3f4700bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:17.119194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fa309966-4fc8-4f9d-ab71-241e3f4700bd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:17.120465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fa309966-4fc8-4f9d-ab71-241e3f4700bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:17.124962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:17.200363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 463/933] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:17.370078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdba54-b809-4a32-80b0-814ab4cb807a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:17.370583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdba54-b809-4a32-80b0-814ab4cb807a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:17.370583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdba54-b809-4a32-80b0-814ab4cb807a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:17.372166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 471/934] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:17.377255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f933-b214-4197-897a-40b607ad6b04 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:17.377770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f933-b214-4197-897a-40b607ad6b04 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:17.378573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f933-b214-4197-897a-40b607ad6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:17.397476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d437f933-b214-4197-897a-40b607ad6b04 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:17.399199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d437f933-b214-4197-897a-40b607ad6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:17.477927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 464/935] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:17.488683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdba54-b809-4a32-80b0-814ab4cb807a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:17.544034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:17.597374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdba54-b809-4a32-80b0-814ab4cb807a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:17.637389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:17.637944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:17.638220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:17.638490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:17.649382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:17.654132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:17.655065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.655945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 472/936] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 16:27:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:17.661668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437f933-b214-4197-897a-40b607ad6b04 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:17.732819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:17.757759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:17.772580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437f933-b214-4197-897a-40b607ad6b04 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:17.825414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:17.826390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:17.826683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:17.827023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:17.827992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:17.828302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:17.829854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:17.841230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 465/937] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 16:27:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:17.847321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:17.872018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206da6-46e7-4ab2-8a45-e057b4fe1511 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:17.888325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:17.910761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:17.911791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:17.912262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:17.912827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:17.913943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:17.915593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:17.918722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING keystone.server.flask.common [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 16:27:17.942493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.sql.core [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:27:17.942493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 16:27:17.942493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [parameters: {'id': '097f66f4fce94163b833b21faffcdc14', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 16:27:17.942493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 097f66f4fce94163b833b21faffcdc14.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 097f66f4fce94163b833b21faffcdc14. Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:27:17.951026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 16:27:17.951900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application yield resource Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise self.value Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application session.commit() Aug 24 16:27:17.952841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:27:17.953720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:27:17.954638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:27:17.955417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [parameters: {'id': '097f66f4fce94163b833b21faffcdc14', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:17.962999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:17.964825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 097f66f4fce94163b833b21faffcdc14. Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 473/938] 10.222.0.88 () {60 vars in 1140 bytes} [Wed Aug 24 16:27:17 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:17.967009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:17.983971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb539c-79e5-41b3-8360-e1e69f2c1c48 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.012548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:18.021777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91a7fb-fcfd-41e2-a497-e479e559d20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.022484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a7fb-fcfd-41e2-a497-e479e559d20e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.022760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a7fb-fcfd-41e2-a497-e479e559d20e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.023026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91a7fb-fcfd-41e2-a497-e479e559d20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.034068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91a7fb-fcfd-41e2-a497-e479e559d20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.035505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91a7fb-fcfd-41e2-a497-e479e559d20e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-5a91a7fb-fcfd-41e2-a497-e479e559d20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:18.050842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:18.052000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:18.052896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:18.052896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:18.052896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:18.052896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 466/939] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:18.053630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa96dd-c4a7-4df1-9bdd-261498b6ead3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.053952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa96dd-c4a7-4df1-9bdd-261498b6ead3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.054230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa96dd-c4a7-4df1-9bdd-261498b6ead3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.055628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 467/940] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:18.060402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa96dd-c4a7-4df1-9bdd-261498b6ead3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.086198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01a30-c458-474d-9c1a-c78e00c18a48 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.121392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed434a-ff85-4b33-b603-c28a284afc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.122031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed434a-ff85-4b33-b603-c28a284afc90 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.122311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed434a-ff85-4b33-b603-c28a284afc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.122589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed434a-ff85-4b33-b603-c28a284afc90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.129912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed434a-ff85-4b33-b603-c28a284afc90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.131658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed434a-ff85-4b33-b603-c28a284afc90 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-d0ed434a-ff85-4b33-b603-c28a284afc90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:18.143247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:18.144314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:18.145202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 474/941] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:18.145975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3de78-33d4-4117-abe5-45530cdac0ee None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.146412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3de78-33d4-4117-abe5-45530cdac0ee None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.146512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3de78-33d4-4117-abe5-45530cdac0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.165501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cae3de78-33d4-4117-abe5-45530cdac0ee None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:18.167038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cae3de78-33d4-4117-abe5-45530cdac0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:18.174148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa96dd-c4a7-4df1-9bdd-261498b6ead3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.186191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:18.211881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.212489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.212764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.213030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.213664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:18.213961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.215322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.228145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 468/942] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:18.228793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.255841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 475/943] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:18.255841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3de78-33d4-4117-abe5-45530cdac0ee None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.282196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:18.355227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19691505-c302-4f64-a8c0-2059cdf0e87a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.377028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3de78-33d4-4117-abe5-45530cdac0ee None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.398732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329b79-dc8f-44ce-8153-fdf618c6f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.399499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329b79-dc8f-44ce-8153-fdf618c6f405 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.399821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329b79-dc8f-44ce-8153-fdf618c6f405 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.400097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329b79-dc8f-44ce-8153-fdf618c6f405 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.401229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329b79-dc8f-44ce-8153-fdf618c6f405 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:18.401541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329b79-dc8f-44ce-8153-fdf618c6f405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.403263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329b79-dc8f-44ce-8153-fdf618c6f405 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.415877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e58ea8-67a1-4f89-bf4b-d72098a4661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.416832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e58ea8-67a1-4f89-bf4b-d72098a4661f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.417297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e58ea8-67a1-4f89-bf4b-d72098a4661f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.417756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e58ea8-67a1-4f89-bf4b-d72098a4661f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.425275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 469/944] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:18.425889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e58ea8-67a1-4f89-bf4b-d72098a4661f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.427448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e58ea8-67a1-4f89-bf4b-d72098a4661f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e5e58ea8-67a1-4f89-bf4b-d72098a4661f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:18.443032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:18.444183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:18.445211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:18.445747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaad7b9-f024-4649-a888-2d85f67338bb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.445747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaad7b9-f024-4649-a888-2d85f67338bb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.445747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaad7b9-f024-4649-a888-2d85f67338bb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.445941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 476/945] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:18.446222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 470/946] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:18.452334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaad7b9-f024-4649-a888-2d85f67338bb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.453045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcde4a-da71-4339-aa8c-662caff0b84d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.453464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcde4a-da71-4339-aa8c-662caff0b84d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.453864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcde4a-da71-4339-aa8c-662caff0b84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.481652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bebcde4a-da71-4339-aa8c-662caff0b84d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:18.484100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bebcde4a-da71-4339-aa8c-662caff0b84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:18.499163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:18.573208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 477/947] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:18.574191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcde4a-da71-4339-aa8c-662caff0b84d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.576980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:18.581484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaad7b9-f024-4649-a888-2d85f67338bb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.623170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.623964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.624344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.624690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.626378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:18.627397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.628525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.648276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 471/948] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:18.653846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.720787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcde4a-da71-4339-aa8c-662caff0b84d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.763063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.764142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.764676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.764949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.765765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.767888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.772673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8d300-27c0-4de7-8f5f-fd7a18b14c62 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:18.779173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:18.780213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:18.781225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 478/949] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:18.789911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.813983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:18.820243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.820887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.821175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.821430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.832922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.834368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:18.853580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:18.854613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:18.855523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:18.855523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:18.855523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:18.855523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 472/950] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:18.855523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.871555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:18.911531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b7ef0-e61e-48f6-b74f-c77ec3eb9df7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:18.947002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:18.947605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:18.947906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:18.948173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:18.948789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:18.949096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:18.950441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:18.963099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 479/951] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:18.963099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:18.981396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0a8a1-7883-4678-a613-5f271c32d3c6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.024777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.025673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.025951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.026221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.026804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.028873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.032905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:19.041432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:19.042487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:19.043829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 473/952] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:19.044822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:19.072628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ded45a-3621-4a35-b53c-ff1270e6da5e None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.110833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.111562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.111947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.112287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.112996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:19.113362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.115130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.124603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:19.131608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 480/953] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:19.131608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:19.160642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03df24-c7f1-4403-af2c-865bba2eb0d1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.197822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.198358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.198641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.198914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.199547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:19.199885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.201246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.205979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 474/954] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:19.206744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:19.246276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2fadb-9247-4cf0-89a8-3eeefb929129 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.278348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:19.284604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.285222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.285501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.285777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.286411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] RBAC: Adding query filter params (name=compute) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:19.286716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.288592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.293620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 481/955] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:19.301718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:19.325394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f689d82-9ea3-499d-a93c-5412d3e298cc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.361834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.362470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.362751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.363140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.370251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.371755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.373688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:19.386712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:19.393152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 475/956] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:19.394129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:19.421062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09b18a-04e4-42e5-9dd9-f8e7b179bdce None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.458619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.459135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.459412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.459794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.460543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.462031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.484510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 482/957] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:19.485679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:19.504738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d611-e78c-4f5a-bcc1-de17041fc515 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.550457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.551051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.551324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.551614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.552266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:19.552564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.554150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.559666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 476/958] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:19.579159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:19.647434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45cebc-527a-4235-9f0a-daa65b0c6c74 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.689972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45b0e-2ab7-450d-9526-adbb07b56bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.690966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45b0e-2ab7-450d-9526-adbb07b56bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.691249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45b0e-2ab7-450d-9526-adbb07b56bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.691520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45b0e-2ab7-450d-9526-adbb07b56bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.692265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45b0e-2ab7-450d-9526-adbb07b56bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:19.692570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45b0e-2ab7-450d-9526-adbb07b56bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.694464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45b0e-2ab7-450d-9526-adbb07b56bd6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.708841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 483/959] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:19.714958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:19.786771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:19.832544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf52cb-e391-4ffa-b254-e894f08c9a67 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:19.871333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b623db5-923c-4b00-ac7b-6366371a97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:19.872416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623db5-923c-4b00-ac7b-6366371a97ac None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:19.872915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623db5-923c-4b00-ac7b-6366371a97ac None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:19.873394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b623db5-923c-4b00-ac7b-6366371a97ac None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/809566003ec643fe82727431941fe3ce/roles/1bff325fd3c94f1ea4e01a5cc670b874` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:19.875803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b623db5-923c-4b00-ac7b-6366371a97ac None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=809566003ec643fe82727431941fe3ce, role_id=1bff325fd3c94f1ea4e01a5cc670b874)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:19.877482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b623db5-923c-4b00-ac7b-6366371a97ac None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:19.897356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 477/960] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:27:19 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/809566003ec643fe82727431941fe3ce/roles/1bff325fd3c94f1ea4e01a5cc670b874 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:27:20.481706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8b46-3e44-45c6-a28b-e4a47cc36579 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:20.482251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8b46-3e44-45c6-a28b-e4a47cc36579 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:20.482251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8b46-3e44-45c6-a28b-e4a47cc36579 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:20.483831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 484/961] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:20.489134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbaf10-b637-4b5b-a046-6d648b0f45c2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:20.489423 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbaf10-b637-4b5b-a046-6d648b0f45c2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:20.489697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcbaf10-b637-4b5b-a046-6d648b0f45c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:20.508278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1dcbaf10-b637-4b5b-a046-6d648b0f45c2 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:20.509459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1dcbaf10-b637-4b5b-a046-6d648b0f45c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:20.577098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 478/962] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:20.843623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b8b46-3e44-45c6-a28b-e4a47cc36579 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:20.949434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b8b46-3e44-45c6-a28b-e4a47cc36579 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:20.963700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:20.993681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:20.994641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:20.995132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:20.995630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:20.996485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:20.998129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:21.015972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.sql.core [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:27:21.015972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 16:27:21.015972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [parameters: {'user_id': '7b32c9e4f1264028a3c51e5ebcd8bf27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 16:27:21.015972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81535) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 16:27:21.023937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:27:21.024900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application yield resource Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise self.value Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application session.commit() Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:27:21.025911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:27:21.026849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:27:21.028463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application result.read() Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:27:21.029785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [parameters: {'user_id': '7b32c9e4f1264028a3c51e5ebcd8bf27', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:21.031754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 16:27:21.033558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 16:27:21.035594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 16:27:21.035594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 16:27:21.035594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:27:21.035594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:27:21.035594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 16:27:21.035594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:21.038241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 485/963] 10.222.0.88 () {60 vars in 1131 bytes} [Wed Aug 24 16:27:20 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:21.044059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbaf10-b637-4b5b-a046-6d648b0f45c2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:21.095191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:21.151078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcbaf10-b637-4b5b-a046-6d648b0f45c2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:21.186508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9ac69-ce32-4e3d-9033-a9a26fb9075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:21.187151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ac69-ce32-4e3d-9033-a9a26fb9075e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.187433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ac69-ce32-4e3d-9033-a9a26fb9075e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.187745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9ac69-ce32-4e3d-9033-a9a26fb9075e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.195547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ac69-ce32-4e3d-9033-a9a26fb9075e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:21.197031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9ac69-ce32-4e3d-9033-a9a26fb9075e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3ea9ac69-ce32-4e3d-9033-a9a26fb9075e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:21.208786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:21.211449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:21.212505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 479/964] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:27:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:21.216255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:21.323089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494e31-68e0-4c0b-9d2e-6d432f98c3ef None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:21.359428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b258365-8581-406d-a3de-9702c94fc9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:21.360145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258365-8581-406d-a3de-9702c94fc9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.360511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258365-8581-406d-a3de-9702c94fc9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.360931 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258365-8581-406d-a3de-9702c94fc9c7 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.361647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b258365-8581-406d-a3de-9702c94fc9c7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:21.361945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b258365-8581-406d-a3de-9702c94fc9c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:21.363614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b258365-8581-406d-a3de-9702c94fc9c7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:21.403505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 486/965] 10.222.0.88 () {56 vars in 1101 bytes} [Wed Aug 24 16:27:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:21.517061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929d69-5973-42be-8762-982f11093360 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.517740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929d69-5973-42be-8762-982f11093360 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.518217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8929d69-5973-42be-8762-982f11093360 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.520189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 480/966] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:21.526462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c53570-95a5-4d77-a6a9-98cea49404ad None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.527445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c53570-95a5-4d77-a6a9-98cea49404ad None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.527963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c53570-95a5-4d77-a6a9-98cea49404ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.548485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-75c53570-95a5-4d77-a6a9-98cea49404ad None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:21.550359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-75c53570-95a5-4d77-a6a9-98cea49404ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:21.580369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:21.632692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 487/967] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:21.666291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd127994-0994-49be-9201-338e8b29f7f4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.666642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd127994-0994-49be-9201-338e8b29f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.666844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd127994-0994-49be-9201-338e8b29f7f4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.668495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 481/968] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:21.674203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a78a12-14cd-45a4-a8b6-be06d300e9ef None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.674543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a78a12-14cd-45a4-a8b6-be06d300e9ef None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.674764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a78a12-14cd-45a4-a8b6-be06d300e9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.695347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-98a78a12-14cd-45a4-a8b6-be06d300e9ef None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:21.696615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-98a78a12-14cd-45a4-a8b6-be06d300e9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:21.765402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 488/969] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:21.895162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac101d6-09f2-49b9-b42e-816723593875 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.895409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac101d6-09f2-49b9-b42e-816723593875 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.895911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac101d6-09f2-49b9-b42e-816723593875 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.897658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 482/970] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:21.902008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a78a12-14cd-45a4-a8b6-be06d300e9ef None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:21.902981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891555a-9d35-405c-8493-ae0c4cf561ad None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:21.903263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891555a-9d35-405c-8493-ae0c4cf561ad None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:21.903505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891555a-9d35-405c-8493-ae0c4cf561ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:21.921282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7891555a-9d35-405c-8493-ae0c4cf561ad None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:21.922461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7891555a-9d35-405c-8493-ae0c4cf561ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:21.991946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 483/971] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:21.998088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.008619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a78a12-14cd-45a4-a8b6-be06d300e9ef None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.030078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891555a-9d35-405c-8493-ae0c4cf561ad None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.043800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.044435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.044722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.044966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.045772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.047523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:22.056595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:22.057673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:22.058574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 489/972] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:22.063976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.077868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.142337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891555a-9d35-405c-8493-ae0c4cf561ad None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.167937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162862d5-0db5-43e5-b8b2-bdb72a36c57a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.180984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.181968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.182375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.182626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.183308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.184748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.203614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 484/973] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:27:22 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:27:22.215808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.216536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.216876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.217206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.217928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:22.218292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.219794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.226327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 490/974] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:22.232600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.256683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.277864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.345045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.349620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ed59-1ac3-4791-b97f-86a1580af29a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.391108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cbfe5-3336-43bc-b2ae-ba621318b10f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.397496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.398203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.398500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.398753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.399433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:22.399764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.401164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.406397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 485/975] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:22.412449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.427789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.428395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.428707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.428979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.439911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:22.445236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:22.446203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:22.447086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 491/976] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:22.452241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.522965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb7d03-79ca-4995-8e08-42d68e915827 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.535051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.560505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829ff5-a3e7-4ec7-9395-1b6b50f7caf1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.561449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.562078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.562358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.562628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.563348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] RBAC: Adding query filter params (interface=admin, service_id=33271406613844a4ba257c4b3dc1f9e3, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:22.563684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.565059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.570481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 486/977] 10.222.0.88 () {56 vars in 1249 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/endpoints?service_id=33271406613844a4ba257c4b3dc1f9e3&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:22.575910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.601025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.601640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.601920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.602219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.603082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:22.603199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.604552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.605734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.615089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 492/978] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:22.620414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.692821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb62fc-7447-49e8-bfba-0f34c450e7cb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.726385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9338b3-e631-4328-8f34-375ebe681853 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.732236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.733059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.733485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.733911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.734670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.736228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.752058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 487/979] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:27:22.764465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.765128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.765406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.765673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.774271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.778832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.780550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:22.797658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:22.798743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:22.804763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:22.804763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:22.804763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:22.804763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 493/980] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:22.806252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:22.915529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:22.925971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667be0-62fb-4805-bf23-fdc6c325e101 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:22.960852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:22.961388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:22.961664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:22.961932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:22.962573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:22.962873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:22.964284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:22.981132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 488/981] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:22.982330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:23.084487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78459db9-21d8-4355-ac82-e90dc7b82182 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:23.118515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:23.119145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:23.119420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:23.119733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:23.127375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:23.129205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:23.140437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:23.141380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:23.142328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 494/982] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:27:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:23.149255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:23.257648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79315a8-a9cf-4875-8cce-c8abc0d45695 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:23.292888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:23.293507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:23.293781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:23.294051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:23.294778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:23.295075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:23.296561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:23.324343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 489/983] 10.222.0.88 () {56 vars in 1149 bytes} [Wed Aug 24 16:27:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:23.325817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:23.378112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:23.430149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac9c8-fa19-41f9-8930-20c3480a4d0f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:23.463777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:23.464380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:23.464654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:23.464901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:23.534814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:23.536214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:23.584526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:23.637809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 495/984] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:23 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:27:23.643764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:23.655911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:23.774372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50712fe0-7494-4a04-95fe-14ac17effa22 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:23.812400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:23.813332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:23.813657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:23.813893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:23.827209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:23.828805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:23.845678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:23.846818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:23.852400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:23.852400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:23.852400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:23.852400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 490/985] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:23.855355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:23.960973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bb2ad-5c0c-4193-a2cd-cbafa8a1e1e4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:23.995853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc270-d93d-48c2-9bae-26f1a93f3d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:23.996628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc270-d93d-48c2-9bae-26f1a93f3d07 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:23.996995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc270-d93d-48c2-9bae-26f1a93f3d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:23.997361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc270-d93d-48c2-9bae-26f1a93f3d07 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:23.998100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc270-d93d-48c2-9bae-26f1a93f3d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:23.998492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc270-d93d-48c2-9bae-26f1a93f3d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:24.000014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc270-d93d-48c2-9bae-26f1a93f3d07 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:24.012788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 496/986] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:24.018540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:24.080386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:24.125308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa58f-645a-40ea-b5bc-b4e1262b3908 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:24.125867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9636-84d5-4a93-8ba4-9a632fda132a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.126036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9636-84d5-4a93-8ba4-9a632fda132a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.126321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c9636-84d5-4a93-8ba4-9a632fda132a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.127843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 497/987] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:24.133391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760012-e35b-41af-b0cd-b5d42a3d98e7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.133675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760012-e35b-41af-b0cd-b5d42a3d98e7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.133947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760012-e35b-41af-b0cd-b5d42a3d98e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.151834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fc760012-e35b-41af-b0cd-b5d42a3d98e7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:24.153004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc760012-e35b-41af-b0cd-b5d42a3d98e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:24.155961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:24.162958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:24.163627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.163908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.164180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.172300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:24.173763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:24.186273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:24.187181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:24.188544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 491/988] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:24.193470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:24.234454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 498/989] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:24.297757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85def7-97d9-45d9-bed1-f75e98956997 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:24.322651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:24.337904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:24.338451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.338737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.338993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.339705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:24.339993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:24.341425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:24.359311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 492/990] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:24.360661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc760012-e35b-41af-b0cd-b5d42a3d98e7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:24.466446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc760012-e35b-41af-b0cd-b5d42a3d98e7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:24.498132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:24.501922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:24.502538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.502842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.503112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.504224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] RBAC: Adding query filter params (role.id=1bff325fd3c94f1ea4e01a5cc670b874, scope.project.id=f928809858b64247862a3901925f8a43, user.id=809566003ec643fe82727431941fe3ce) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:24.504531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:24.505970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:24.519649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 499/991] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:24 2022] GET /identity/v3/role_assignments?user.id=809566003ec643fe82727431941fe3ce&scope.project.id=f928809858b64247862a3901925f8a43&role.id=1bff325fd3c94f1ea4e01a5cc670b874 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:24.618980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090ab67-e2e3-42b4-a238-9d14082a68bb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:24.658363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5dc47-f626-4279-ac99-fd7e846c03fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:24.658998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5dc47-f626-4279-ac99-fd7e846c03fc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.659269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5dc47-f626-4279-ac99-fd7e846c03fc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.659533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5dc47-f626-4279-ac99-fd7e846c03fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.660144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5dc47-f626-4279-ac99-fd7e846c03fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:24.661522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5dc47-f626-4279-ac99-fd7e846c03fc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-25a5dc47-f626-4279-ac99-fd7e846c03fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:24.670702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:24.671800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:24.672635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 493/992] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:24.678828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:24.683650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498abec-51de-4e97-b172-981706827e38 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.684164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498abec-51de-4e97-b172-981706827e38 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.684614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498abec-51de-4e97-b172-981706827e38 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.684870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:24.686497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 494/993] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:24.693136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0853c-f1c1-486d-9e37-fd0ec46d3684 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.693355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0853c-f1c1-486d-9e37-fd0ec46d3684 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.694658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0853c-f1c1-486d-9e37-fd0ec46d3684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.713316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e1d0853c-f1c1-486d-9e37-fd0ec46d3684 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:24.714508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e1d0853c-f1c1-486d-9e37-fd0ec46d3684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:24.762170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:24.787291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0aa3-4c18-42fa-8b75-6117d6fdbf84 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:24.796058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 495/994] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:24.824390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:24.825011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.825292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.825563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.826189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:24.826493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:24.827888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:24.837727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 500/995] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:24.838904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0853c-f1c1-486d-9e37-fd0ec46d3684 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:24.945681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0853c-f1c1-486d-9e37-fd0ec46d3684 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:24.981946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:24.982558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:24.982833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:24.983105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:24.983778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:24.984083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:24.985460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:24.995684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 496/996] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:24.997197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:25.064871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:25.065817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:25.101533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886691-f354-4735-93c7-d77c10c9955a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:25.109147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:25.143046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:25.143676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:25.144362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:25.144643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:25.145347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] RBAC: Adding query filter params (interface=public, service_id=a6d1151342ef4d6cbb313b2c47e2c234, region_id=RegionOne) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:25.145654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:25.147794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:25.153764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 501/997] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:27:24 2022] GET /identity/v3/endpoints?service_id=a6d1151342ef4d6cbb313b2c47e2c234&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:25.159224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:25.176638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde219-980b-4afe-b9a8-50bc19162e51 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:25.211363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:25.211930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:25.212205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:25.212469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:25.213045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:25.214404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:25.222965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:25.223970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:25.228499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 497/998] 10.222.0.88 () {56 vars in 1126 bytes} [Wed Aug 24 16:27:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:25.230282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:25.274098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821328-0d6c-4491-8bdd-bb6283c042be None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:25.314298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:25.321019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:25.321692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:25.321976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:25.322255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:25.322859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:25.324335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:25.330922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 502/999] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:27:25 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:27:25.351751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c20a95-ea4f-49af-b13a-73822c22cfef None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:25.353824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:25.393109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:25.393752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:25.393988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:25.394282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:25.394910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:25.395206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:25.396645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:25.402877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 498/1000] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:25.409073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:25.520437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88837b5-c079-4d95-ae07-afa73c3beddb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:25.554106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6076abd-43db-4e66-bc6e-a09837218d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:25.554716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6076abd-43db-4e66-bc6e-a09837218d3f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:25.554989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6076abd-43db-4e66-bc6e-a09837218d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:25.555253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6076abd-43db-4e66-bc6e-a09837218d3f None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:25.555913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6076abd-43db-4e66-bc6e-a09837218d3f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:25.556208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6076abd-43db-4e66-bc6e-a09837218d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:25.557610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6076abd-43db-4e66-bc6e-a09837218d3f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:25.562689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 503/1001] 10.222.0.88 () {56 vars in 1122 bytes} [Wed Aug 24 16:27:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:25.568257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:25.675076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d65227-7c7a-4b66-914e-55e4828909f3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:25.710371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984a1ad-2fa9-4129-b65c-e81067d3443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:25.710977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a1ad-2fa9-4129-b65c-e81067d3443b None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:25.711255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a1ad-2fa9-4129-b65c-e81067d3443b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:25.711522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a1ad-2fa9-4129-b65c-e81067d3443b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:25.712220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984a1ad-2fa9-4129-b65c-e81067d3443b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:25.713579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984a1ad-2fa9-4129-b65c-e81067d3443b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:25.735612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 499/1002] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:26.499602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a926b-81d8-48c0-a6c5-50cd17ada948 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:26.500178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a926b-81d8-48c0-a6c5-50cd17ada948 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:26.500178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a926b-81d8-48c0-a6c5-50cd17ada948 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:26.501695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 504/1003] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:26.507296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad1d0-0877-4571-8a62-b9a2dd27954d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:26.507751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad1d0-0877-4571-8a62-b9a2dd27954d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:26.507848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ad1d0-0877-4571-8a62-b9a2dd27954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:26.527043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-148ad1d0-0877-4571-8a62-b9a2dd27954d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:26.529405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-148ad1d0-0877-4571-8a62-b9a2dd27954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:26.551024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:26.607295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 500/1004] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:26.868940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a926b-81d8-48c0-a6c5-50cd17ada948 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:26.935828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:26.979682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a926b-81d8-48c0-a6c5-50cd17ada948 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:27.013626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:27.014256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.014529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.014777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.015351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:27.016758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:27.025373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:27.026350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:27.027181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:27.031285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 505/1005] 10.222.0.88 () {56 vars in 1105 bytes} [Wed Aug 24 16:27:26 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:27.032663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad1d0-0877-4571-8a62-b9a2dd27954d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:27.141719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ad1d0-0877-4571-8a62-b9a2dd27954d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:27.179325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b792e-67d5-474a-8b57-e4df4f02302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:27.180032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b792e-67d5-474a-8b57-e4df4f02302d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.180312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b792e-67d5-474a-8b57-e4df4f02302d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.180580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b792e-67d5-474a-8b57-e4df4f02302d None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.181215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b792e-67d5-474a-8b57-e4df4f02302d None admin] RBAC: Adding query filter params (name=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:27.181513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b792e-67d5-474a-8b57-e4df4f02302d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:27.182876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b792e-67d5-474a-8b57-e4df4f02302d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:27.191652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 501/1006] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:27.194812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:27.238792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af006f4-afc3-467d-9b44-6047c6a5b7ff None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.239152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af006f4-afc3-467d-9b44-6047c6a5b7ff None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.239344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af006f4-afc3-467d-9b44-6047c6a5b7ff None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.240943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 502/1007] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:27.246102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a97c-cb2d-460e-b970-0fdac15a0ab9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.246384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a97c-cb2d-460e-b970-0fdac15a0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.246677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a97c-cb2d-460e-b970-0fdac15a0ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.265036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-93e5a97c-cb2d-460e-b970-0fdac15a0ab9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:27.266232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-93e5a97c-cb2d-460e-b970-0fdac15a0ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:27.277616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:27.307349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d3804-81e9-4703-aedd-d5e938066df6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:27.334706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:27.347119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 503/1008] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:27.347268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deec73-eea2-4414-9cde-6594f4b201da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:27.347869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deec73-eea2-4414-9cde-6594f4b201da None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.348150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deec73-eea2-4414-9cde-6594f4b201da None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.348424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deec73-eea2-4414-9cde-6594f4b201da None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.349057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13deec73-eea2-4414-9cde-6594f4b201da None admin] RBAC: Adding query filter params (type=image) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:27.349358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13deec73-eea2-4414-9cde-6594f4b201da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:27.351021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13deec73-eea2-4414-9cde-6594f4b201da None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:27.363613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 506/1009] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:27.614004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5a97c-cb2d-460e-b970-0fdac15a0ab9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:27.635859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02863f-bdc2-413c-858c-46702701888d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.636389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02863f-bdc2-413c-858c-46702701888d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.636389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02863f-bdc2-413c-858c-46702701888d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.638480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 507/1010] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:27.643622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba83a3a-e021-4b37-ac1e-29461a8c6428 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.643919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba83a3a-e021-4b37-ac1e-29461a8c6428 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.644193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba83a3a-e021-4b37-ac1e-29461a8c6428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.664198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8ba83a3a-e021-4b37-ac1e-29461a8c6428 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:27.665397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8ba83a3a-e021-4b37-ac1e-29461a8c6428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:27.721096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5a97c-cb2d-460e-b970-0fdac15a0ab9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:27.747813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 508/1011] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:27.756704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:27.757585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.757930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.758263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.758911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:27.760368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:27.769168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:27.770149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:27.773001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 504/1012] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:27.776438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba83a3a-e021-4b37-ac1e-29461a8c6428 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:27.879482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba83a3a-e021-4b37-ac1e-29461a8c6428 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:27.897532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:27.916071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:27.916680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:27.916957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:27.917222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:27.917849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] RBAC: Adding query filter params (name=compute) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:27.918146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:27.919508 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:27.929532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 509/1013] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:27.930509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:27.944061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:28.009673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:28.036271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb37d40-47d0-4e63-ab7b-b1ea4a1fb450 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:28.072635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:28.073216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:28.073504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:28.073773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:28.074394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:28.074690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:28.076092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:28.081221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 505/1014] 10.222.0.88 () {56 vars in 1112 bytes} [Wed Aug 24 16:27:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:28.086978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:28.120889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ad29c-33e5-4f4c-8bab-487fa6a32fec None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:28.156676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:28.157226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:28.157502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:28.157769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:28.158848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:28.160382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:28.162106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 510/1015] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:28.163984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:28.167830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:28.191382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b09edf-88d2-402b-8149-6909f1780bf2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:28.217206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:28.229472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e37ed-1460-4750-bd28-ce79c20584a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:28.230076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e37ed-1460-4750-bd28-ce79c20584a8 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:28.230356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e37ed-1460-4750-bd28-ce79c20584a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:28.230624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e37ed-1460-4750-bd28-ce79c20584a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:28.231280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e37ed-1460-4750-bd28-ce79c20584a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:28.232718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e37ed-1460-4750-bd28-ce79c20584a8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:28.256182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 506/1016] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:28.284064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9249e35-c17e-42f2-8365-3af70daf3a00 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:28.341710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffa59c-2f95-4500-ae83-89bc53aa79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:28.342339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa59c-2f95-4500-ae83-89bc53aa79b2 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:28.342617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa59c-2f95-4500-ae83-89bc53aa79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:28.342885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa59c-2f95-4500-ae83-89bc53aa79b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:28.343528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffa59c-2f95-4500-ae83-89bc53aa79b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:28.345035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffa59c-2f95-4500-ae83-89bc53aa79b2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:28.383634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 511/1017] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:27:28 2022] POST /identity/v3/projects => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:29.278392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43709a6-3a47-4a3f-abb0-5c98acc21bcc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:29.278972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43709a6-3a47-4a3f-abb0-5c98acc21bcc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:29.278972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43709a6-3a47-4a3f-abb0-5c98acc21bcc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:29.280395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 507/1018] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:29.285782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc5df-5098-4f9e-88d9-437f29f98575 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:29.286214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc5df-5098-4f9e-88d9-437f29f98575 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:29.286291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cc5df-5098-4f9e-88d9-437f29f98575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:29.305437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-343cc5df-5098-4f9e-88d9-437f29f98575 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:29.307018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-343cc5df-5098-4f9e-88d9-437f29f98575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:29.379618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 512/1019] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:29 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:29.642710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43709a6-3a47-4a3f-abb0-5c98acc21bcc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:29.755524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43709a6-3a47-4a3f-abb0-5c98acc21bcc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:29.785590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:29.793637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc236ece-69bf-4b8c-902c-6486d78d74af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:29.794322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236ece-69bf-4b8c-902c-6486d78d74af None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:29.794598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236ece-69bf-4b8c-902c-6486d78d74af None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:29.794871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc236ece-69bf-4b8c-902c-6486d78d74af None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:29.795540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc236ece-69bf-4b8c-902c-6486d78d74af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:29.797236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc236ece-69bf-4b8c-902c-6486d78d74af None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:29.815655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 508/1020] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:27:29 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:30.252106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44766-1913-4de5-b4e9-0b51e812a8b7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:30.252357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44766-1913-4de5-b4e9-0b51e812a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:30.252608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44766-1913-4de5-b4e9-0b51e812a8b7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:30.256921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 513/1021] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:30.260473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f37c92-5169-4d7c-85ad-d73cdaae71b0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:30.260755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f37c92-5169-4d7c-85ad-d73cdaae71b0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:30.261033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f37c92-5169-4d7c-85ad-d73cdaae71b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:30.280312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-01f37c92-5169-4d7c-85ad-d73cdaae71b0 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:30.281511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-01f37c92-5169-4d7c-85ad-d73cdaae71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:30.354529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e492eb-ce0c-4463-af45-c93377bb55a7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:30.355477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e492eb-ce0c-4463-af45-c93377bb55a7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:30.355795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e492eb-ce0c-4463-af45-c93377bb55a7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:30.357300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 514/1022] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:30.362373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415538-d214-4b51-bb0d-dd6d00919f1b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:30.362660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415538-d214-4b51-bb0d-dd6d00919f1b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:30.362933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415538-d214-4b51-bb0d-dd6d00919f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:30.370270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 509/1023] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:30.383870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-08415538-d214-4b51-bb0d-dd6d00919f1b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:30.385074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-08415538-d214-4b51-bb0d-dd6d00919f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:30.409786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:30.460136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 515/1024] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:30.634846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f37c92-5169-4d7c-85ad-d73cdaae71b0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:30.729267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415538-d214-4b51-bb0d-dd6d00919f1b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:30.747413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f37c92-5169-4d7c-85ad-d73cdaae71b0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:30.765805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:30.787182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:30.787890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:30.788166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:30.788433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:30.799591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:30.804953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:30.805976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:30.806804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 510/1025] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 16:27:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:30.811741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:30.840511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415538-d214-4b51-bb0d-dd6d00919f1b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:30.876530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:30.877170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:30.877446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:30.877712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:30.879140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:30.880615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:30.882553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 516/1026] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:30.888319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:30.916622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:30.920916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2187-6aea-4b20-8ff1-3a40b644feea None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:30.957980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:30.959083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:30.959369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:30.960006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:30.960687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:30.960990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:30.963337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:30.975924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 511/1027] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 16:27:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:30.978368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:30.995771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ffd14-8ade-408a-9e76-ed50403254a3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:31.019004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:31.031918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:31.032532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.032814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.033086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.033733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:31.035172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:31.059561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 517/1028] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:27:30 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:27:31.088501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19aecb1-5488-4df4-a105-ed716f027d22 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:31.126732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:31.127845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.128791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.129352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.142529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:31.144362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:31.161161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:31.162184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:31.163207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:31.163207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:31.163207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:31.165020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 512/1029] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:31.171372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:31.264557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:31.285416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4205fc8-62dd-420f-adff-386779cdcefb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:31.326447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:31.327121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.327398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.327696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.328349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:31.328650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:31.330038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:31.343107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 518/1030] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:31.349041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:31.445865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:31.456843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767544db-b363-4e48-9953-a09436e5e30c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:31.492874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:31.493502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.493746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.494040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.501618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:31.503042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:31.515387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:31.516414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:31.518081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:31.518861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 513/1031] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:27:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:31.522921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:31.631680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ba46f-42de-4f71-96c8-a1e5ab38e6f1 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:31.668331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a64e7-d67f-4c0a-9163-933911f21d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:31.668937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a64e7-d67f-4c0a-9163-933911f21d77 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.669213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a64e7-d67f-4c0a-9163-933911f21d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.669474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a64e7-d67f-4c0a-9163-933911f21d77 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.670197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a64e7-d67f-4c0a-9163-933911f21d77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:31.670493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a64e7-d67f-4c0a-9163-933911f21d77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:31.671960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a64e7-d67f-4c0a-9163-933911f21d77 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:31.687691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:31.696024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 519/1032] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:27:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:31.697856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:31.725025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ae518-2dc2-4d61-84ee-9c124c9736b7 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.725338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ae518-2dc2-4d61-84ee-9c124c9736b7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.725628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ae518-2dc2-4d61-84ee-9c124c9736b7 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.727133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 520/1033] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:31.731883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84979-e065-4efb-b9f4-280ad0b52027 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.732145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84979-e065-4efb-b9f4-280ad0b52027 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.732435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84979-e065-4efb-b9f4-280ad0b52027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.750312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1ac84979-e065-4efb-b9f4-280ad0b52027 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:31.751403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1ac84979-e065-4efb-b9f4-280ad0b52027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:31.803741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f848-8a19-4080-bf12-0e5ca8025984 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:31.826915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 521/1034] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:31.841371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:31.842216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:31.842557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:31.842954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:31.862770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:31.913982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:31.915417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.017043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 514/1035] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:32.023094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac84979-e065-4efb-b9f4-280ad0b52027 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.099420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.129355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac84979-e065-4efb-b9f4-280ad0b52027 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.154990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:32.162368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:32.170525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.171157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.171538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.171847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.183716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.185393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:32.201704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:32.202706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:32.204248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:32.204248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:32.204248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:32.204248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 522/1036] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:32.208445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.209888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58bc5b-9429-4ce9-862d-b32d60528bdb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.248490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.249128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.249407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.249679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.250266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.251668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:32.261259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:32.262237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:32.263082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 515/1037] 10.222.0.88 () {56 vars in 1105 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:32.268287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.328548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ea02-2639-4c43-bbf9-14d3fbaf5eda None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.364693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.365312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.365594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.365867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.366826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:32.367133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.368549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.382101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 523/1038] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:32.383669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6bb5-efa8-4a5a-8bba-38e53b1457a9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.387738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.400562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:32.423283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.424280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.424280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.424486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.425094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] RBAC: Adding query filter params (name=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:32.425399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.426775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.433186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:32.435610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 516/1039] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:32.439524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.504253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ee940-64d4-400f-807a-b6d03d1012b7 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.544665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27716e52-9ada-4283-a5ed-230e0301d43e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.544845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.545500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.545608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.545864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.552610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.554253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:32.566748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:32.567690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:32.568585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 524/1040] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:32.574071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.586848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.587465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.587778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.588050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.588802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:32.588986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.590350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.595758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 517/1041] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:32.601744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.648554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:32.690078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8226f-d95a-4801-994e-eb98b2ab2ea6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.691982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:32.715078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee264d5-be61-4c46-90b5-72df46afa4b2 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.728876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.729859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.730284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.730561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.731264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:32.731592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.733588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.748639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 525/1042] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:32.754036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.754599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.754877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.755000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.755166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.755872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] RBAC: Adding query filter params (interface=public, service_id=936fd025d7e8478db8575afb29af9dcc, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:32.756177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.757829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.768081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 518/1043] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/endpoints?service_id=936fd025d7e8478db8575afb29af9dcc&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:32.769050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:32.869523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d128f-936c-4d44-b93a-b4bc065cb1f5 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.879394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e5aad-fba9-4664-a9e9-3d59de238724 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:32.888520 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:32.906904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c937b-f6c2-435e-bb73-79a3b96d3962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.907518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c937b-f6c2-435e-bb73-79a3b96d3962 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.907838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c937b-f6c2-435e-bb73-79a3b96d3962 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.908093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c937b-f6c2-435e-bb73-79a3b96d3962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.908884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c937b-f6c2-435e-bb73-79a3b96d3962 None admin] RBAC: Adding query filter params (role.id=1bff325fd3c94f1ea4e01a5cc670b874, scope.project.id=f928809858b64247862a3901925f8a43, user.id=ff19f92d804245ba908c5609bd133ca2) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:32.909125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c937b-f6c2-435e-bb73-79a3b96d3962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.910559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c937b-f6c2-435e-bb73-79a3b96d3962 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.916983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 526/1044] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/role_assignments?user.id=ff19f92d804245ba908c5609bd133ca2&scope.project.id=f928809858b64247862a3901925f8a43&role.id=1bff325fd3c94f1ea4e01a5cc670b874 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:32.921457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc484384-98a6-4564-bd23-6dd72528be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:32.922089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484384-98a6-4564-bd23-6dd72528be1d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:32.922366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484384-98a6-4564-bd23-6dd72528be1d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:32.922633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484384-98a6-4564-bd23-6dd72528be1d None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:32.923250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc484384-98a6-4564-bd23-6dd72528be1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:32.924692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc484384-98a6-4564-bd23-6dd72528be1d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:32.939878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 519/1045] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:27:32 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:27:33.062444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9b22-64cf-45c1-a095-bf2ef76c0dae None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:33.062853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9b22-64cf-45c1-a095-bf2ef76c0dae None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:33.063026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9b22-64cf-45c1-a095-bf2ef76c0dae None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:33.064513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 527/1046] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:33.070742 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458446-0e7e-4515-a15d-17e14711af9d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:33.070983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458446-0e7e-4515-a15d-17e14711af9d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:33.071381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458446-0e7e-4515-a15d-17e14711af9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:33.091719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8a458446-0e7e-4515-a15d-17e14711af9d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:33.093331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8a458446-0e7e-4515-a15d-17e14711af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:33.165536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 520/1047] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:33.431876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9b22-64cf-45c1-a095-bf2ef76c0dae None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:33.463020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:33.542658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9b22-64cf-45c1-a095-bf2ef76c0dae None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:33.577193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:33.577863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:33.578082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:33.578358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:33.588674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:33.593275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:33.594220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:33.596593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 528/1048] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:33.600482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458446-0e7e-4515-a15d-17e14711af9d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:33.699007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:33.702633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458446-0e7e-4515-a15d-17e14711af9d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:33.737818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:33.738431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:33.738703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:33.738961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:33.739670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:33.739972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:33.741487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:33.751438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 521/1049] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:33.757676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:33.846436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:33.863389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848fc4c-e78e-4167-a82e-69d526307ee8 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:33.898711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:33.899351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:33.899655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:33.899925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] PATH_INFO: `/v3/users/de8b97a323bf455c8c533b3cac5f6150` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:33.913998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] RBAC: Authorizing `identity:get_user(user_id=de8b97a323bf455c8c533b3cac5f6150)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:33.915497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:33.917313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 529/1050] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:33 2022] GET /identity/v3/users/de8b97a323bf455c8c533b3cac5f6150 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:33.923123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:34.028115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b7b5-413f-48b6-bc6c-0ce8e7ed59d3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:34.064517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:34.065134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:34.065410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:34.065674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:34.095567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:34.136014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:34.137465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:34.235862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 522/1051] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:27:34.241664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:34.352541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6badd04-02bb-4fdf-962d-1eb967d43e35 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:34.389521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a1894-3f2a-4b2b-8270-b85acc77db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:34.390157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1894-3f2a-4b2b-8270-b85acc77db55 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:34.390432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1894-3f2a-4b2b-8270-b85acc77db55 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:34.390702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a1894-3f2a-4b2b-8270-b85acc77db55 None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:34.391912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a1894-3f2a-4b2b-8270-b85acc77db55 None admin] RBAC: Authorizing `identity:get_project(project_id=b588ab945557414cb637a1672f6d1aba)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:34.393391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a1894-3f2a-4b2b-8270-b85acc77db55 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:34.395162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 530/1052] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:27:34 2022] GET /identity/v3/projects/b588ab945557414cb637a1672f6d1aba => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:34.401363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:34.464729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:34.507342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ad8bd-b756-4d3e-bdb3-7948ac32e9eb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:34.542073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cb962-c5c1-4510-9e02-34f348ce6afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:34.542671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb962-c5c1-4510-9e02-34f348ce6afa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:34.542950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb962-c5c1-4510-9e02-34f348ce6afa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:34.543220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb962-c5c1-4510-9e02-34f348ce6afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:34.543977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cb962-c5c1-4510-9e02-34f348ce6afa None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=b588ab945557414cb637a1672f6d1aba, user.id=de8b97a323bf455c8c533b3cac5f6150) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:34.544288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cb962-c5c1-4510-9e02-34f348ce6afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:34.545718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cb962-c5c1-4510-9e02-34f348ce6afa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:34.551594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 523/1053] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:34 2022] GET /identity/v3/role_assignments?user.id=de8b97a323bf455c8c533b3cac5f6150&scope.project.id=b588ab945557414cb637a1672f6d1aba&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:34.799816 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334867-2710-445c-9940-e490b93facc2 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:34.800346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334867-2710-445c-9940-e490b93facc2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:34.800346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334867-2710-445c-9940-e490b93facc2 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:34.801800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 531/1054] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:34.807078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ecc7-80da-4beb-9562-bedbcff6c4e7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:34.807497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ecc7-80da-4beb-9562-bedbcff6c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:34.807572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ecc7-80da-4beb-9562-bedbcff6c4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:34.826852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-28a4ecc7-80da-4beb-9562-bedbcff6c4e7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:34.828098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-28a4ecc7-80da-4beb-9562-bedbcff6c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:34.849930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be892b26-5d2f-406c-8d52-aabd198408d9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:34.850262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be892b26-5d2f-406c-8d52-aabd198408d9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:34.850545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be892b26-5d2f-406c-8d52-aabd198408d9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:34.851890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 532/1055] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:34.856926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf0a85-e5b0-46d6-91f9-b99b356d3746 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:34.857208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf0a85-e5b0-46d6-91f9-b99b356d3746 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:34.857504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf0a85-e5b0-46d6-91f9-b99b356d3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:34.876303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a5bf0a85-e5b0-46d6-91f9-b99b356d3746 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:34.877529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a5bf0a85-e5b0-46d6-91f9-b99b356d3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:34.885940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:34.903775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 524/1056] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:34.952528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 533/1057] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:35.165953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4ecc7-80da-4beb-9562-bedbcff6c4e7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.218890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf0a85-e5b0-46d6-91f9-b99b356d3746 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.226276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:35.276890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4ecc7-80da-4beb-9562-bedbcff6c4e7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.315344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.316453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.316734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.317150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.328253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:35.328416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf0a85-e5b0-46d6-91f9-b99b356d3746 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:35.333115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:35.334037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:35.336532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 525/1058] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:35.340236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.364680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.365320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.365601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.365873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] PATH_INFO: `/v3/services/image` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.366525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:35.367976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:35.376944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:35.377951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:35.379206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 534/1059] 10.222.0.88 () {56 vars in 1105 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:35.384272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.393817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:35.450713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7938e-ec82-44e2-b83e-a48f9e92696b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.468010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:35.487958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.488571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.488851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.489121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.489785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:35.490086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:35.491736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:35.493308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850361ab-4376-4c0c-b437-2374cdcb61dc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.503731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 526/1060] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:35.506026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.533004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.533624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.533901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.534336 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.534798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] RBAC: Adding query filter params (name=image) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:35.535102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:35.536521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:35.541954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 535/1061] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:35.547319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.621828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:35.623179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c8d84-c638-4d6a-a04e-e465c9b4283f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.658837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bf3f8-6871-4106-a6d7-f53dad250c0a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.660841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.661775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.661775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.661973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.673428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:35.675560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:35.690350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:35.691335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:35.693063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:35.693063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:35.693063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:35.693063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 527/1062] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:35.696765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.697319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.697513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.697716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.697911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.698521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] RBAC: Adding query filter params (type=image) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:35.698819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:35.700229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:35.706271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 536/1063] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:35.711709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.732630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:35.807095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a782-c14b-4e25-a8ef-c073faea8c9e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.826497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fc241-5f63-4246-bd39-624f2ea3e79d None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:35.842296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.842903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.843180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.843450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.844157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:35.844446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:35.845804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:35.858407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 528/1064] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:35.864160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:35.867205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:35.867882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:35.868283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:35.868389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:35.869044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:35.870424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:35.876023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:35.903248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 537/1065] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:27:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:27:35.986573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:35.998461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd21b6-a2ca-4afe-912c-50ea22793517 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:36.044563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:36.045082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.045458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.045842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.055184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:36.056719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:36.069030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:36.070959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:36.072103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 529/1066] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:27:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:36.076649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:36.190057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e1ced-8567-4ff9-8b21-9690472e10da None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:36.228148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457656c8-4eb9-4fc4-a9fe-72b3e21db998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:36.228768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457656c8-4eb9-4fc4-a9fe-72b3e21db998 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.229048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457656c8-4eb9-4fc4-a9fe-72b3e21db998 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.229384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457656c8-4eb9-4fc4-a9fe-72b3e21db998 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.230123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457656c8-4eb9-4fc4-a9fe-72b3e21db998 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:36.230429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457656c8-4eb9-4fc4-a9fe-72b3e21db998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:36.231912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457656c8-4eb9-4fc4-a9fe-72b3e21db998 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:36.250654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 538/1067] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:27:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:36.256522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:36.370129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457cb7e-958d-4be9-a19c-86b3642ff316 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:36.405438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:36.406071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.406346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.406615 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.418102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:36.419566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:36.426399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:36.432461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f82b7-3e60-4064-a0b4-459e4be336b6 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.432833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f82b7-3e60-4064-a0b4-459e4be336b6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.433177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f82b7-3e60-4064-a0b4-459e4be336b6 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.434751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 539/1068] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:36.436570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:36.437723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:36.438779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:36.438779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:36.438779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:36.440467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b97a-a5f5-46cd-811d-11f006a096da None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.440860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b97a-a5f5-46cd-811d-11f006a096da None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.441215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b97a-a5f5-46cd-811d-11f006a096da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.443527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 530/1069] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:36.444282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:36.461087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d717b97a-a5f5-46cd-811d-11f006a096da None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:36.462287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d717b97a-a5f5-46cd-811d-11f006a096da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:36.525413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:36.552730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 540/1070] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:36.566928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff50b89-34d7-4562-b722-a2b0e9896ddc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:36.604528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:36.605135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.605413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.605684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.606322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:36.606621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:36.608665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:36.620502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 531/1071] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:36.626249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b97a-a5f5-46cd-811d-11f006a096da None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:36.727090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b97a-a5f5-46cd-811d-11f006a096da None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:36.762100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:36.762744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.763019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.763287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.771057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:36.772599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:36.783547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:36.784538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:36.785430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:36.787947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 541/1072] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:36.790760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:36.816175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:36.855460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:36.860581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:36.901113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6f474-2a58-4bca-9c95-61dcf1926b72 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:36.927695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6233-e4f1-4d4a-bcc5-1c4576ea9d4a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:36.936384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:36.936997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.937277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.937547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.938232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:36.938532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:36.940040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:36.956605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 532/1073] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:36.958432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:36.963153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:36.963821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:36.964100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:36.964370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:36.974952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:36.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:36.981243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:36.982133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 542/1074] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:36.987283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:37.072391 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add53569-3f38-42ba-89b4-7de1b5ff3722 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:37.090105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:37.090349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:37.094897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e6792-01d3-4e53-a8af-060f62dd075f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:37.110092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:37.110748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:37.111028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:37.111358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/ff19f92d804245ba908c5609bd133ca2/roles/1bff325fd3c94f1ea4e01a5cc670b874` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:37.113539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=ff19f92d804245ba908c5609bd133ca2, role_id=1bff325fd3c94f1ea4e01a5cc670b874)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:37.114976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:37.139608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 533/1075] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:27:36 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/ff19f92d804245ba908c5609bd133ca2/roles/1bff325fd3c94f1ea4e01a5cc670b874 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:27:37.139862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:37.139862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:37.139862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:37.139862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:37.140208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:37.140208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:37.140208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:37.144961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 543/1076] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:37.151225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:37.263061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595a3a-f704-4d01-ba74-c13ccc31db12 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:37.306576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:37.307180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:37.307891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:37.307891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] PATH_INFO: `/v3/users/de8b97a323bf455c8c533b3cac5f6150` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:37.309016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=de8b97a323bf455c8c533b3cac5f6150)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:37.310574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:37.315624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 534/1077] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:37 2022] GET /identity/v3/users/de8b97a323bf455c8c533b3cac5f6150 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:37.318391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:37.421794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e399a03-f43d-49e4-8765-378a8bdf4050 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:37.456724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eda85-38c5-4ebf-a512-28ceb3811c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:37.457533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eda85-38c5-4ebf-a512-28ceb3811c27 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:37.457904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eda85-38c5-4ebf-a512-28ceb3811c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:37.458296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eda85-38c5-4ebf-a512-28ceb3811c27 None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:37.459507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eda85-38c5-4ebf-a512-28ceb3811c27 None admin] RBAC: Authorizing `identity:get_project(project_id=b588ab945557414cb637a1672f6d1aba)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:37.461291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eda85-38c5-4ebf-a512-28ceb3811c27 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:37.463189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 544/1078] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:27:37 2022] GET /identity/v3/projects/b588ab945557414cb637a1672f6d1aba => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:37.469309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:37.518209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:37.577318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b5db-327f-480a-a0b6-ff70c2bd1fd7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:37.612287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778de96-9804-406c-b4ba-3d98761a7d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:37.612961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778de96-9804-406c-b4ba-3d98761a7d41 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:37.613244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778de96-9804-406c-b4ba-3d98761a7d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:37.613514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778de96-9804-406c-b4ba-3d98761a7d41 None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba/users/de8b97a323bf455c8c533b3cac5f6150/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:37.615422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778de96-9804-406c-b4ba-3d98761a7d41 None admin] RBAC: Authorizing `identity:create_grant(project_id=b588ab945557414cb637a1672f6d1aba, user_id=de8b97a323bf455c8c533b3cac5f6150, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:37.617137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778de96-9804-406c-b4ba-3d98761a7d41 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:37.633074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 535/1079] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:27:37 2022] PUT /identity/v3/projects/b588ab945557414cb637a1672f6d1aba/users/de8b97a323bf455c8c533b3cac5f6150/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:27:37.837000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73794-1c3a-45d3-9856-54b2fa701fcb None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:37.837368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73794-1c3a-45d3-9856-54b2fa701fcb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:37.837542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73794-1c3a-45d3-9856-54b2fa701fcb None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:37.838941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 545/1080] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:37.844361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c3a3-9eb4-4b7e-8c27-6797d18688f5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:37.844652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c3a3-9eb4-4b7e-8c27-6797d18688f5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:37.844900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c3a3-9eb4-4b7e-8c27-6797d18688f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:37.863371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6780c3a3-9eb4-4b7e-8c27-6797d18688f5 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:37.864602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6780c3a3-9eb4-4b7e-8c27-6797d18688f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:37.947513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 536/1081] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:38.214302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a73794-1c3a-45d3-9856-54b2fa701fcb None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:38.246501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:38.333768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a73794-1c3a-45d3-9856-54b2fa701fcb None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:38.371531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:38.372179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:38.372437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:38.372737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:38.442883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:38.444513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:38.472964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:38.551630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 546/1082] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:38.557621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c3a3-9eb4-4b7e-8c27-6797d18688f5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:38.595085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:38.665601 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c3a3-9eb4-4b7e-8c27-6797d18688f5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:38.702637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44141db-cd4f-44fc-8390-cf5bc56b5a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:38.703280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44141db-cd4f-44fc-8390-cf5bc56b5a78 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:38.703552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44141db-cd4f-44fc-8390-cf5bc56b5a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:38.703842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44141db-cd4f-44fc-8390-cf5bc56b5a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:38.715021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44141db-cd4f-44fc-8390-cf5bc56b5a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:38.716495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44141db-cd4f-44fc-8390-cf5bc56b5a78 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d44141db-cd4f-44fc-8390-cf5bc56b5a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:38.731217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:38.732387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:38.733312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:38.733312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:38.733312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:38.733312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 537/1083] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:38.739617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:38.844793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25c118-27aa-4a17-a461-c1e6ce5a9332 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:38.872288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:38.882104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4a89e-d65f-485f-b69b-926f93eca365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:38.882726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4a89e-d65f-485f-b69b-926f93eca365 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:38.883001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4a89e-d65f-485f-b69b-926f93eca365 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:38.883266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4a89e-d65f-485f-b69b-926f93eca365 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:38.883948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4a89e-d65f-485f-b69b-926f93eca365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:38.884246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4a89e-d65f-485f-b69b-926f93eca365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:38.885608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4a89e-d65f-485f-b69b-926f93eca365 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:38.897542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 547/1084] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:39.026080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905abfd6-bc2a-4572-829e-4622e948af4f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:39.026617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905abfd6-bc2a-4572-829e-4622e948af4f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:39.026617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905abfd6-bc2a-4572-829e-4622e948af4f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:39.028127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 538/1085] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:39.033871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2701-3ad7-425c-8fb9-d19b407afb91 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:39.034122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2701-3ad7-425c-8fb9-d19b407afb91 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:39.034427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2701-3ad7-425c-8fb9-d19b407afb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:39.052967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-025c2701-3ad7-425c-8fb9-d19b407afb91 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:39.054212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-025c2701-3ad7-425c-8fb9-d19b407afb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:39.126045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 548/1086] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:39.388349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905abfd6-bc2a-4572-829e-4622e948af4f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:39.484254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:39.499225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905abfd6-bc2a-4572-829e-4622e948af4f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:39.529095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74787-f263-47b3-8304-d711441c8123 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:39.529613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74787-f263-47b3-8304-d711441c8123 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:39.529613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74787-f263-47b3-8304-d711441c8123 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:39.530968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 549/1087] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:27:39.535874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d205-9a4b-471f-baff-82f180aa76ab None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:39.536153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d205-9a4b-471f-baff-82f180aa76ab None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:39.536345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc449-d203-48df-a441-77d769268de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:39.536459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d205-9a4b-471f-baff-82f180aa76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:39.536990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc449-d203-48df-a441-77d769268de5 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:39.537269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc449-d203-48df-a441-77d769268de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:39.537537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc449-d203-48df-a441-77d769268de5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:39.548904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cc449-d203-48df-a441-77d769268de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-691cc449-d203-48df-a441-77d769268de5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:39.553590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:39.554826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:27:39.555988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:39.556708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c251d205-9a4b-471f-baff-82f180aa76ab None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:39.556783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 539/1088] 10.222.0.88 () {56 vars in 1120 bytes} [Wed Aug 24 16:27:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:39.556851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c251d205-9a4b-471f-baff-82f180aa76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:39.560804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc449-d203-48df-a441-77d769268de5 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:39.625927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 550/1089] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:27:39.672689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc449-d203-48df-a441-77d769268de5 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:39.712139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:39.712751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:39.713028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:39.713296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:39.713959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:39.714259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:39.715612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:39.723585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 540/1090] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 16:27:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:39.729764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d205-9a4b-471f-baff-82f180aa76ab None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:39.783776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:39.833502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d205-9a4b-471f-baff-82f180aa76ab None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:39.868022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:39.868642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:39.868914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:39.869178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:39.879756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:39.881203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:39.893719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:39.895818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:39.896915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:39.898461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:39.898461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:39.898461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:39.898461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 551/1091] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:39.903008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:39.909446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.003943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e1663-86e4-4d2e-b3ea-fa09faf676cb None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.018915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.022551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13908aba-a4fc-4239-afd8-9b4cffd9c377 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.039519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.040187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.040459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.040723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.051613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:27:40.056253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:40.057227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:40.058059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 541/1092] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:40.058760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.058849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.059146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.059358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.060035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:40.060338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.061720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.063385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.074815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 552/1093] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:40.080553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.135294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.167243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894c9c0-9909-4ed6-92c2-a541af506dfc None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.181675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fdff9-b119-4f55-9a29-10122499a585 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.201261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.201910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.202193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.202488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.203146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:40.203479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.204903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.213610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 542/1094] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:40.216414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.217049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.217352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.217593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.219463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.225151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.226629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:27:40.238039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:40.239090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:40.240069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 553/1095] 10.222.0.88 () {56 vars in 1093 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:40.245072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.267739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.320176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac3dfd-aa43-4ad5-9307-5e8993ce2ed4 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.351000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ed104-c7dc-4f33-85c9-442c61decb08 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.351318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.357194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.357833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.358100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.358372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] PATH_INFO: `/v3/users/de8b97a323bf455c8c533b3cac5f6150` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.359533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] RBAC: Authorizing `identity:get_user(user_id=de8b97a323bf455c8c533b3cac5f6150)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.360990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.362579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 543/1096] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/users/de8b97a323bf455c8c533b3cac5f6150 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:40.368496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.385683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.386227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.386505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.386772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.387491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:40.387826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.389263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.407086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 554/1097] 10.222.0.88 () {56 vars in 1133 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:40.412905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.472184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250617-06f8-47bc-96d6-a8b63cf351fa None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.487812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.505712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.506327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.506598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.506892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.512920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff413435-e137-41c1-89c5-bac9ea05ae2a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.552199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.552904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.553114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.553392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.570329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.572728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.574950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.623096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.624603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.677777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 544/1098] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:27:40.684548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.705085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.728255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 555/1099] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:27:40.734230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.781465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.784932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc3842-1d3d-45c4-a50e-b7ae35e42b76 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.821700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.822329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.822605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.822871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.824003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] RBAC: Authorizing `identity:get_project(project_id=b588ab945557414cb637a1672f6d1aba)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.825434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.827072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 545/1100] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/projects/b588ab945557414cb637a1672f6d1aba => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:40.833138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.837782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db63989-b5f7-479f-a5c9-c82cd34e3abb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.872634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.873263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.873536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.873800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.884445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.885865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:27:40.900795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:40.901923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:27:40.902832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:27:40.902832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:27:40.902832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:27:40.902832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 556/1101] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:27:40.907882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:40.929311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532044-3897-4247-80ea-c369ee61fb04 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:40.937011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:40.962363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:40.962964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:40.963242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:40.963485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:40.964250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=b588ab945557414cb637a1672f6d1aba, user.id=de8b97a323bf455c8c533b3cac5f6150) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:40.964553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:40.965980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:40.971815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 546/1102] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/role_assignments?user.id=de8b97a323bf455c8c533b3cac5f6150&scope.project.id=b588ab945557414cb637a1672f6d1aba&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:41.011117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c9e5-38c1-48bf-a9f9-9a0f39d50a63 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:41.049440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:41.050160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:41.050276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:41.050506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:41.051199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:41.051506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:41.052959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:41.065988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 557/1103] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:27:41.072319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:41.106177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:41.181674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33078-8252-46a9-9579-75ef03ab4a41 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:41.216217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:41.216852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:41.217208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:41.217488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:41.224353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:41.225839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:27:41.236951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:27:41.238001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:27:41.238951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 547/1104] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:27:41.244121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:41.343440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:41.354109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b621-e713-43ff-a810-7a9ef85a8ebb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:41.388128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f521ba-d1cc-4d6e-ad1b-449d654d9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:41.388729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f521ba-d1cc-4d6e-ad1b-449d654d9a07 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:41.389098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f521ba-d1cc-4d6e-ad1b-449d654d9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:41.389383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f521ba-d1cc-4d6e-ad1b-449d654d9a07 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:41.390064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f521ba-d1cc-4d6e-ad1b-449d654d9a07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:41.390367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f521ba-d1cc-4d6e-ad1b-449d654d9a07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:41.391815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f521ba-d1cc-4d6e-ad1b-449d654d9a07 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:41.403282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 558/1105] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:41.409831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:41.509722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:41.519497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1a966-0869-42aa-8109-6b9410044436 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:41.554092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ed906-e18c-4c06-b2aa-ccded9de3d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:41.554395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ed906-e18c-4c06-b2aa-ccded9de3d59 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:41.554685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ed906-e18c-4c06-b2aa-ccded9de3d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:41.554965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ed906-e18c-4c06-b2aa-ccded9de3d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:41.555713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ed906-e18c-4c06-b2aa-ccded9de3d59 None admin] RBAC: Adding query filter params (role.id=1bff325fd3c94f1ea4e01a5cc670b874, scope.project.id=f928809858b64247862a3901925f8a43, user.id=ff19f92d804245ba908c5609bd133ca2) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:41.556015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ed906-e18c-4c06-b2aa-ccded9de3d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:41.557435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ed906-e18c-4c06-b2aa-ccded9de3d59 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:41.563465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 548/1106] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:41 2022] GET /identity/v3/role_assignments?user.id=ff19f92d804245ba908c5609bd133ca2&scope.project.id=f928809858b64247862a3901925f8a43&role.id=1bff325fd3c94f1ea4e01a5cc670b874 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:42.894628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc574c04-6a79-411e-af2d-dc2ddcbe363d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:42.895215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc574c04-6a79-411e-af2d-dc2ddcbe363d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:42.895215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc574c04-6a79-411e-af2d-dc2ddcbe363d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:42.896563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 559/1107] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:42.903258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bae185-26d3-4557-9a4f-627de10bd96b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:42.904096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bae185-26d3-4557-9a4f-627de10bd96b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:42.904240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bae185-26d3-4557-9a4f-627de10bd96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:42.931859 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-05bae185-26d3-4557-9a4f-627de10bd96b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:42.933050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-05bae185-26d3-4557-9a4f-627de10bd96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:43.002232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 549/1108] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:43.277968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc574c04-6a79-411e-af2d-dc2ddcbe363d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:43.392649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc574c04-6a79-411e-af2d-dc2ddcbe363d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:43.428135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e95b-6d26-49e9-b008-6df5ac3bce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:43.428908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e95b-6d26-49e9-b008-6df5ac3bce4c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:43.429189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e95b-6d26-49e9-b008-6df5ac3bce4c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:43.429459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e95b-6d26-49e9-b008-6df5ac3bce4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:43.430700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e95b-6d26-49e9-b008-6df5ac3bce4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:43.432209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e95b-6d26-49e9-b008-6df5ac3bce4c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:43.433801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 560/1109] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:43.439873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bae185-26d3-4557-9a4f-627de10bd96b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:43.526713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:43.541695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bae185-26d3-4557-9a4f-627de10bd96b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:43.578286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0f22a-8ff9-4d5a-8056-1e6d1feb4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:43.578886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f22a-8ff9-4d5a-8056-1e6d1feb4630 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:43.579171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f22a-8ff9-4d5a-8056-1e6d1feb4630 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:43.579429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0f22a-8ff9-4d5a-8056-1e6d1feb4630 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:43.580097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0f22a-8ff9-4d5a-8056-1e6d1feb4630 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:43.581542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0f22a-8ff9-4d5a-8056-1e6d1feb4630 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:43.605821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 550/1110] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:27:43 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:45.563977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cf883-9738-4555-83c7-29e0f564d24a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:45.564777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cf883-9738-4555-83c7-29e0f564d24a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:45.564777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cf883-9738-4555-83c7-29e0f564d24a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:45.566968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 561/1111] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:45.573530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e8a55-9228-4a1b-9a08-2c6933838a97 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:45.573980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e8a55-9228-4a1b-9a08-2c6933838a97 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:45.574109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e8a55-9228-4a1b-9a08-2c6933838a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:45.595405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f64e8a55-9228-4a1b-9a08-2c6933838a97 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:45.596627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f64e8a55-9228-4a1b-9a08-2c6933838a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:45.670558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 551/1112] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:45.941829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cf883-9738-4555-83c7-29e0f564d24a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:45.971266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:46.068473 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cf883-9738-4555-83c7-29e0f564d24a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:46.107312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:46.108017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:46.108248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:46.108516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] PATH_INFO: `/v3/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:46.109991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] RBAC: Authorizing `identity:get_role(role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:46.111385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:46.112834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 562/1113] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:45 2022] GET /identity/v3/roles/66545c4116b74dad93fef433e2619ef8 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:46.119117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e8a55-9228-4a1b-9a08-2c6933838a97 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:46.200494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:46.231042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e8a55-9228-4a1b-9a08-2c6933838a97 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:46.266094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:46.266720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:46.266998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:46.267264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] PATH_INFO: `/v3/users/d707967b0d6a426a9c5d60663a18eb46` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:46.281158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] RBAC: Authorizing `identity:get_user(user_id=d707967b0d6a426a9c5d60663a18eb46)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:46.282618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:46.284274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 552/1114] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:46 2022] GET /identity/v3/users/d707967b0d6a426a9c5d60663a18eb46 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:46.290558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:46.379410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:46.395265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48d486-dd74-4865-83bd-ca504347d388 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:46.428670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:46.429342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:46.429620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:46.429887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:46.509046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:46.511098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:46.625176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:46.651166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 563/1115] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:46.658183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:46.770590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be0eb-5255-4cfe-8d44-9de5117e5404 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:46.801719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:46.808772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f86954-0480-464c-a465-a167274d37c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:46.809402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86954-0480-464c-a465-a167274d37c9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:46.809681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86954-0480-464c-a465-a167274d37c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:46.809951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86954-0480-464c-a465-a167274d37c9 None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:46.811172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f86954-0480-464c-a465-a167274d37c9 None admin] RBAC: Authorizing `identity:get_project(project_id=b588ab945557414cb637a1672f6d1aba)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:46.812630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f86954-0480-464c-a465-a167274d37c9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:46.814338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 553/1116] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:27:46 2022] GET /identity/v3/projects/b588ab945557414cb637a1672f6d1aba => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:46.820835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:46.934550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eca03-0dfd-41ba-b405-300ffaf6d570 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:46.970164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388bd34-756c-4dba-b7e3-b97ed7d3f3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:46.970764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388bd34-756c-4dba-b7e3-b97ed7d3f3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:46.971038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388bd34-756c-4dba-b7e3-b97ed7d3f3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:46.971310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388bd34-756c-4dba-b7e3-b97ed7d3f3f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:46.972041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388bd34-756c-4dba-b7e3-b97ed7d3f3f7 None admin] RBAC: Adding query filter params (role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=b588ab945557414cb637a1672f6d1aba, user.id=d707967b0d6a426a9c5d60663a18eb46) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:46.972347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388bd34-756c-4dba-b7e3-b97ed7d3f3f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:46.973781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388bd34-756c-4dba-b7e3-b97ed7d3f3f7 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:46.979266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 564/1117] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:46 2022] GET /identity/v3/role_assignments?user.id=d707967b0d6a426a9c5d60663a18eb46&scope.project.id=b588ab945557414cb637a1672f6d1aba&role.id=66545c4116b74dad93fef433e2619ef8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:48.857624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfca72-b072-4e4e-a2d6-f0a4fbebd1ab None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:48.858467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfca72-b072-4e4e-a2d6-f0a4fbebd1ab None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:48.858467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfca72-b072-4e4e-a2d6-f0a4fbebd1ab None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:48.860631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 554/1118] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:48.866820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a754c-907a-4457-9a33-79cb07d319ec None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:48.867261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a754c-907a-4457-9a33-79cb07d319ec None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:48.867470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a754c-907a-4457-9a33-79cb07d319ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:48.887824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-368a754c-907a-4457-9a33-79cb07d319ec None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:48.889051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-368a754c-907a-4457-9a33-79cb07d319ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:48.942926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:48.966899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 565/1119] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:49.230507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfca72-b072-4e4e-a2d6-f0a4fbebd1ab None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:49.348214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfca72-b072-4e4e-a2d6-f0a4fbebd1ab None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:49.393092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:49.393721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:49.394001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:49.394275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] PATH_INFO: `/v3/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:49.395889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] RBAC: Authorizing `identity:get_role(role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:49.397223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:49.398534 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 555/1120] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:49 2022] GET /identity/v3/roles/66545c4116b74dad93fef433e2619ef8 => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:49.404639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a754c-907a-4457-9a33-79cb07d319ec None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:49.507055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a754c-907a-4457-9a33-79cb07d319ec None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:49.545497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:49.546115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:49.546393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:49.546666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] PATH_INFO: `/v3/users/d707967b0d6a426a9c5d60663a18eb46` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:49.547879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] RBAC: Authorizing `identity:get_user(user_id=d707967b0d6a426a9c5d60663a18eb46)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:49.549333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:49.550904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 566/1121] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:49 2022] GET /identity/v3/users/d707967b0d6a426a9c5d60663a18eb46 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:49.556882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:49.625054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:49.674632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487b220-6ba3-453a-9105-7f8a7908c9d3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:49.711939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9195e3-966e-4e95-ac89-4769f8aa32a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:49.712563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9195e3-966e-4e95-ac89-4769f8aa32a8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:49.712850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9195e3-966e-4e95-ac89-4769f8aa32a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:49.713124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9195e3-966e-4e95-ac89-4769f8aa32a8 None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:49.714281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9195e3-966e-4e95-ac89-4769f8aa32a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b588ab945557414cb637a1672f6d1aba)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:49.715765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9195e3-966e-4e95-ac89-4769f8aa32a8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:49.717420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 556/1122] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:27:49 2022] GET /identity/v3/projects/b588ab945557414cb637a1672f6d1aba => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:49.723736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:49.779658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:49.833078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb104ad8-7b6a-475b-a242-cf2ad8bfa690 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:49.876247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec0571-3b9d-4c95-a357-040388cb4d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:49.877264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0571-3b9d-4c95-a357-040388cb4d13 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:49.877736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0571-3b9d-4c95-a357-040388cb4d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:49.878162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec0571-3b9d-4c95-a357-040388cb4d13 None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba/users/d707967b0d6a426a9c5d60663a18eb46/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:49.882542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec0571-3b9d-4c95-a357-040388cb4d13 None admin] RBAC: Authorizing `identity:create_grant(project_id=b588ab945557414cb637a1672f6d1aba, user_id=d707967b0d6a426a9c5d60663a18eb46, role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:49.884044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec0571-3b9d-4c95-a357-040388cb4d13 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:49.902711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 567/1123] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:27:49 2022] PUT /identity/v3/projects/b588ab945557414cb637a1672f6d1aba/users/d707967b0d6a426a9c5d60663a18eb46/roles/66545c4116b74dad93fef433e2619ef8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:27:51.787915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7442-141f-437d-8bb4-75f3d4fa21fa None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:51.788917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7442-141f-437d-8bb4-75f3d4fa21fa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:51.788917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7442-141f-437d-8bb4-75f3d4fa21fa None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:51.790005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 557/1124] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:51.796501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b74e-a19b-4462-8888-97ad69c76a9e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:51.797247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b74e-a19b-4462-8888-97ad69c76a9e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:51.797387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b74e-a19b-4462-8888-97ad69c76a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:51.820902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7fa9b74e-a19b-4462-8888-97ad69c76a9e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:51.822112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7fa9b74e-a19b-4462-8888-97ad69c76a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:51.898073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 568/1125] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:52.178530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7442-141f-437d-8bb4-75f3d4fa21fa None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:52.286127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7442-141f-437d-8bb4-75f3d4fa21fa None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:52.322682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:52.323303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:52.323572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:52.323879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] PATH_INFO: `/v3/roles/66545c4116b74dad93fef433e2619ef8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:52.325339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] RBAC: Authorizing `identity:get_role(role_id=66545c4116b74dad93fef433e2619ef8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:52.326780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:52.328087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 558/1126] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:52 2022] GET /identity/v3/roles/66545c4116b74dad93fef433e2619ef8 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:52.334699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9b74e-a19b-4462-8888-97ad69c76a9e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:52.385698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:52.455246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9b74e-a19b-4462-8888-97ad69c76a9e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:52.492094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:52.492729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:52.493010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:52.493282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] PATH_INFO: `/v3/users/d707967b0d6a426a9c5d60663a18eb46` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:52.494487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] RBAC: Authorizing `identity:get_user(user_id=d707967b0d6a426a9c5d60663a18eb46)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:52.495966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:52.497562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 569/1127] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:27:52 2022] GET /identity/v3/users/d707967b0d6a426a9c5d60663a18eb46 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:52.507755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:52.512458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:52.617115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64d54e-b1fb-475d-87e2-32dca56437c6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:52.661825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:52.662439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:52.662718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:52.662993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:52.739484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:52.740930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:52.743329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:52.853788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 559/1128] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:27:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:27:52.860746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:52.968832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cefc1-63cc-4e02-aefb-65cab3d106e9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:52.976537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:53.008130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253e34-798e-4ffe-ae26-9c148b0f906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:53.008688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253e34-798e-4ffe-ae26-9c148b0f906b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:53.008966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253e34-798e-4ffe-ae26-9c148b0f906b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:53.009238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253e34-798e-4ffe-ae26-9c148b0f906b None admin] PATH_INFO: `/v3/projects/b588ab945557414cb637a1672f6d1aba` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:53.010428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253e34-798e-4ffe-ae26-9c148b0f906b None admin] RBAC: Authorizing `identity:get_project(project_id=b588ab945557414cb637a1672f6d1aba)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:53.011909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253e34-798e-4ffe-ae26-9c148b0f906b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:53.013558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 570/1129] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:27:52 2022] GET /identity/v3/projects/b588ab945557414cb637a1672f6d1aba => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:53.020022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:53.140673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d645a-dc33-4263-8387-a0208142ab41 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:53.142365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:53.180976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f373a-961a-4b5b-9de9-c5a6c422e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:53.181580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f373a-961a-4b5b-9de9-c5a6c422e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:53.181860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f373a-961a-4b5b-9de9-c5a6c422e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:53.182133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f373a-961a-4b5b-9de9-c5a6c422e8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:53.182856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f373a-961a-4b5b-9de9-c5a6c422e8d1 None admin] RBAC: Adding query filter params (role.id=66545c4116b74dad93fef433e2619ef8, scope.project.id=b588ab945557414cb637a1672f6d1aba, user.id=d707967b0d6a426a9c5d60663a18eb46) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:27:53.183163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f373a-961a-4b5b-9de9-c5a6c422e8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:53.184635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f373a-961a-4b5b-9de9-c5a6c422e8d1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:53.190590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 560/1130] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:27:53 2022] GET /identity/v3/role_assignments?user.id=d707967b0d6a426a9c5d60663a18eb46&scope.project.id=b588ab945557414cb637a1672f6d1aba&role.id=66545c4116b74dad93fef433e2619ef8 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:55.090760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2727e24-5f87-41a9-9944-46e8a291abd3 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:55.091751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2727e24-5f87-41a9-9944-46e8a291abd3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:55.091751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2727e24-5f87-41a9-9944-46e8a291abd3 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:55.093679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 571/1131] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:55.099300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9918a-8868-4aa5-b9ae-0c75eef36ea1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:55.099773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9918a-8868-4aa5-b9ae-0c75eef36ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:55.099864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9918a-8868-4aa5-b9ae-0c75eef36ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:55.118872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-76b9918a-8868-4aa5-b9ae-0c75eef36ea1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:55.120095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-76b9918a-8868-4aa5-b9ae-0c75eef36ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:55.203572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 561/1132] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:55.482658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2727e24-5f87-41a9-9944-46e8a291abd3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:55.600072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2727e24-5f87-41a9-9944-46e8a291abd3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:55.641798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128c5e2-1d3b-4692-81aa-ff148566998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:55.642717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5e2-1d3b-4692-81aa-ff148566998b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:55.643078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5e2-1d3b-4692-81aa-ff148566998b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:55.643450 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c5e2-1d3b-4692-81aa-ff148566998b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:55.645389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128c5e2-1d3b-4692-81aa-ff148566998b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:55.647769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128c5e2-1d3b-4692-81aa-ff148566998b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:55.649416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 572/1133] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:55.655500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9918a-8868-4aa5-b9ae-0c75eef36ea1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:55.757730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:55.765069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9918a-8868-4aa5-b9ae-0c75eef36ea1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:55.802926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0165366-3cbc-4b89-b55a-d3744b8713a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:55.803531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165366-3cbc-4b89-b55a-d3744b8713a9 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:55.803872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165366-3cbc-4b89-b55a-d3744b8713a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:55.804169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0165366-3cbc-4b89-b55a-d3744b8713a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:55.804925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165366-3cbc-4b89-b55a-d3744b8713a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:55.806356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0165366-3cbc-4b89-b55a-d3744b8713a9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:55.837485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 562/1134] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:27:55 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:27:57.781589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1bbd3-d7d2-426a-9e97-65a807a9d251 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:57.782135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1bbd3-d7d2-426a-9e97-65a807a9d251 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:57.782135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1bbd3-d7d2-426a-9e97-65a807a9d251 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:57.783388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 573/1135] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:27:57.790042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b9586-bc5f-49cf-9a89-8188570348f7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:57.790810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b9586-bc5f-49cf-9a89-8188570348f7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:57.790969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b9586-bc5f-49cf-9a89-8188570348f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:57.814475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6c3b9586-bc5f-49cf-9a89-8188570348f7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:27:57.815691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6c3b9586-bc5f-49cf-9a89-8188570348f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:27:57.885103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 563/1136] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:27:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:27:58.167290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1bbd3-d7d2-426a-9e97-65a807a9d251 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:58.221927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:58.295619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1bbd3-d7d2-426a-9e97-65a807a9d251 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:58.334289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1ebed-5439-4339-aa1d-e8bdf2534ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:58.334924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1ebed-5439-4339-aa1d-e8bdf2534ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:58.335356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1ebed-5439-4339-aa1d-e8bdf2534ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:58.336002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1ebed-5439-4339-aa1d-e8bdf2534ed9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:58.337182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1ebed-5439-4339-aa1d-e8bdf2534ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:58.338632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1ebed-5439-4339-aa1d-e8bdf2534ed9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:58.340266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 574/1137] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:27:58.346786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b9586-bc5f-49cf-9a89-8188570348f7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:27:58.436919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:27:58.461808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b9586-bc5f-49cf-9a89-8188570348f7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:27:58.497830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71177e21-d798-4420-a265-493af258244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:27:58.498432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71177e21-d798-4420-a265-493af258244b None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:27:58.498705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71177e21-d798-4420-a265-493af258244b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:27:58.498984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71177e21-d798-4420-a265-493af258244b None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:27:58.499613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71177e21-d798-4420-a265-493af258244b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:27:58.501091 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71177e21-d798-4420-a265-493af258244b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:27:58.528778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 564/1138] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:27:58 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:28:00.478658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37a083-4dd5-4c07-8b3c-a651a16acd97 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:00.479235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37a083-4dd5-4c07-8b3c-a651a16acd97 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:00.479235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37a083-4dd5-4c07-8b3c-a651a16acd97 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:00.480611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 575/1139] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:00.488771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903cd6-0dbe-47ac-aa4a-c67841fe3085 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:00.489448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903cd6-0dbe-47ac-aa4a-c67841fe3085 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:00.489657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903cd6-0dbe-47ac-aa4a-c67841fe3085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:00.516101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-86903cd6-0dbe-47ac-aa4a-c67841fe3085 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:00.517292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-86903cd6-0dbe-47ac-aa4a-c67841fe3085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:00.590441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 565/1140] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:00.857592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37a083-4dd5-4c07-8b3c-a651a16acd97 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:00.973711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37a083-4dd5-4c07-8b3c-a651a16acd97 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:00.984583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:01.019208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:01.020337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:01.020721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:01.021124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:01.032263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:28:01.036862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:28:01.037977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:01.039574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:28:01.043208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 576/1141] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:28:01.044413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86903cd6-0dbe-47ac-aa4a-c67841fe3085 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:01.107023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:01.155290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86903cd6-0dbe-47ac-aa4a-c67841fe3085 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:01.190757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:01.191389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:01.191699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:01.191969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:01.192632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:01.192938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:01.194321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:01.202763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 566/1142] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:28:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:01.212360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:01.329091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b1d9-0fd4-48a1-b3ce-880f5d9fa3ae None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:01.366711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:01.367337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:01.367625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:01.367915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] PATH_INFO: `/v3/users/e8adbe813b5944a2ba96aa2048d6cad5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:01.383339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e8adbe813b5944a2ba96aa2048d6cad5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:01.384822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:01.386433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 577/1143] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:28:01 2022] GET /identity/v3/users/e8adbe813b5944a2ba96aa2048d6cad5 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:01.393666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:01.527684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690ba40-ce4d-4b25-9de8-482c6255f682 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:01.554077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:01.569017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:01.569921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:01.570605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:01.570966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:01.663207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:01.664799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:01.767679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 567/1144] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:28:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:28:01.774984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:01.817188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:01.895885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50960f50-a0b9-4c10-8f25-56fed5e6b2c2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:01.930063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d68e7-d0f7-480c-9b36-40e61de1ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:01.930675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d68e7-d0f7-480c-9b36-40e61de1ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:01.930948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d68e7-d0f7-480c-9b36-40e61de1ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:01.931218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d68e7-d0f7-480c-9b36-40e61de1ccc8 None admin] PATH_INFO: `/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:01.932476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d68e7-d0f7-480c-9b36-40e61de1ccc8 None admin] RBAC: Authorizing `identity:get_project(project_id=394d0e58e7e94b89a11bc5b1074deb4b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:01.933911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d68e7-d0f7-480c-9b36-40e61de1ccc8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:01.935539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 578/1145] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:28:01 2022] GET /identity/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:01.942227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:01.971597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:02.052101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db593d-32d0-4c35-a2e9-d04be9421de6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:02.088475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ce9c8-eba1-46e8-a7a1-7dc56b2368b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:02.089008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ce9c8-eba1-46e8-a7a1-7dc56b2368b4 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:02.089260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ce9c8-eba1-46e8-a7a1-7dc56b2368b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:02.089563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ce9c8-eba1-46e8-a7a1-7dc56b2368b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:02.090288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ce9c8-eba1-46e8-a7a1-7dc56b2368b4 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=394d0e58e7e94b89a11bc5b1074deb4b, user.id=e8adbe813b5944a2ba96aa2048d6cad5) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:02.090597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ce9c8-eba1-46e8-a7a1-7dc56b2368b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:02.092080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ce9c8-eba1-46e8-a7a1-7dc56b2368b4 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:02.097627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 568/1146] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:28:01 2022] GET /identity/v3/role_assignments?user.id=e8adbe813b5944a2ba96aa2048d6cad5&scope.project.id=394d0e58e7e94b89a11bc5b1074deb4b&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:03.949482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e585a-a67b-4303-89a5-369ced2fa34e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:03.950073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e585a-a67b-4303-89a5-369ced2fa34e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:03.950073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e585a-a67b-4303-89a5-369ced2fa34e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:03.951387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 579/1147] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:03.957694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d75911-7309-47d6-99f3-c370ca8e951d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:03.958381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d75911-7309-47d6-99f3-c370ca8e951d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:03.958564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d75911-7309-47d6-99f3-c370ca8e951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:03.978227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-14d75911-7309-47d6-99f3-c370ca8e951d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:03.979414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-14d75911-7309-47d6-99f3-c370ca8e951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:04.056530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 569/1148] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:04.322410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e585a-a67b-4303-89a5-369ced2fa34e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:04.441364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:04.449269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e585a-a67b-4303-89a5-369ced2fa34e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:04.486951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:04.487616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:04.487881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:04.488152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:04.499234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:28:04.504257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:28:04.505341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:04.506362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:28:04.507808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 580/1149] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:28:04.512317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d75911-7309-47d6-99f3-c370ca8e951d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:04.538041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:04.619774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d75911-7309-47d6-99f3-c370ca8e951d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:04.654878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:04.655480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:04.655787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:04.656056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:04.656731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:04.657033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:04.658406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:04.666466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 570/1150] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:04.672593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:04.791086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55073d4-3fba-4412-a9e5-1b90c869507c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:04.836667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:04.837309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:04.837590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:04.837862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] PATH_INFO: `/v3/users/e8adbe813b5944a2ba96aa2048d6cad5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:04.839208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] RBAC: Authorizing `identity:get_user(user_id=e8adbe813b5944a2ba96aa2048d6cad5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:04.840725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:04.842377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 581/1151] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:28:04 2022] GET /identity/v3/users/e8adbe813b5944a2ba96aa2048d6cad5 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:04.851787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:04.943979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:04.963342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce3c43-a2af-4f6c-9fe2-83b18778936e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:04.998411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aebd2a-3495-49fe-ad9f-5fe1784f71e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:04.999027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aebd2a-3495-49fe-ad9f-5fe1784f71e0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:04.999300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aebd2a-3495-49fe-ad9f-5fe1784f71e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:04.999565 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aebd2a-3495-49fe-ad9f-5fe1784f71e0 None admin] PATH_INFO: `/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:05.000865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aebd2a-3495-49fe-ad9f-5fe1784f71e0 None admin] RBAC: Authorizing `identity:get_project(project_id=394d0e58e7e94b89a11bc5b1074deb4b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:05.002294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aebd2a-3495-49fe-ad9f-5fe1784f71e0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:05.004298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 571/1152] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:28:04 2022] GET /identity/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:28:05.010641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:05.047454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:05.128244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f6aba-2da1-4175-9d71-c8383be2ab3f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:05.165387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea95bf-c147-460d-af59-eb9795a0a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:05.166036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea95bf-c147-460d-af59-eb9795a0a91b None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:05.166314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea95bf-c147-460d-af59-eb9795a0a91b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:05.166585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea95bf-c147-460d-af59-eb9795a0a91b None admin] PATH_INFO: `/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b/users/e8adbe813b5944a2ba96aa2048d6cad5/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:05.168604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea95bf-c147-460d-af59-eb9795a0a91b None admin] RBAC: Authorizing `identity:create_grant(project_id=394d0e58e7e94b89a11bc5b1074deb4b, user_id=e8adbe813b5944a2ba96aa2048d6cad5, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:05.170060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea95bf-c147-460d-af59-eb9795a0a91b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:05.190380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 582/1153] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:28:05 2022] PUT /identity/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b/users/e8adbe813b5944a2ba96aa2048d6cad5/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:28:07.054327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3515-f91f-474e-b6be-191eef643094 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:07.054894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3515-f91f-474e-b6be-191eef643094 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:07.054894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3515-f91f-474e-b6be-191eef643094 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:07.056227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 572/1154] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:07.062723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dbc6-abab-4aa5-a7cd-1535e6aa42c3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:07.063408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dbc6-abab-4aa5-a7cd-1535e6aa42c3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:07.063552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001dbc6-abab-4aa5-a7cd-1535e6aa42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:07.091598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5001dbc6-abab-4aa5-a7cd-1535e6aa42c3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:07.092839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5001dbc6-abab-4aa5-a7cd-1535e6aa42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:07.165504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 583/1155] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:07.440438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3515-f91f-474e-b6be-191eef643094 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:07.556407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3515-f91f-474e-b6be-191eef643094 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:07.591290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:07.591851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:07.592125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:07.592390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:07.603186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:28:07.607851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:28:07.611748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:28:07.612893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 573/1156] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:28:07.617033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001dbc6-abab-4aa5-a7cd-1535e6aa42c3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:07.634094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:07.738729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001dbc6-abab-4aa5-a7cd-1535e6aa42c3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:07.775369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:07.776005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:07.776286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:07.776559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:07.777223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:07.777526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:07.778920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:07.787105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 584/1157] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:07.794011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:07.810923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:07.908483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cf0f4-26f1-450d-ac74-d5f1d2f78d13 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:07.961421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:07.962048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:07.962328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:07.962599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] PATH_INFO: `/v3/users/e8adbe813b5944a2ba96aa2048d6cad5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:07.963882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] RBAC: Authorizing `identity:get_user(user_id=e8adbe813b5944a2ba96aa2048d6cad5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:07.965324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:07.966920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 574/1158] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:28:07 2022] GET /identity/v3/users/e8adbe813b5944a2ba96aa2048d6cad5 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:07.973362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:08.056680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:08.082712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63051a-8bcd-4299-bd39-a22031b79adb None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:08.120552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:08.121154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:08.121439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:08.121717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:08.199897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:08.201314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:08.284983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:08.311213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 585/1159] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:28:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:28:08.317405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:08.409817 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:08.439417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6863f0-272c-453f-bfa5-22b312306960 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:08.479113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed3ad-1bc9-4814-bfc9-1f79643063b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:08.479993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed3ad-1bc9-4814-bfc9-1f79643063b8 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:08.480299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed3ad-1bc9-4814-bfc9-1f79643063b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:08.480612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed3ad-1bc9-4814-bfc9-1f79643063b8 None admin] PATH_INFO: `/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:08.482330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ed3ad-1bc9-4814-bfc9-1f79643063b8 None admin] RBAC: Authorizing `identity:get_project(project_id=394d0e58e7e94b89a11bc5b1074deb4b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:08.484568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ed3ad-1bc9-4814-bfc9-1f79643063b8 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:08.486991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 575/1160] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:28:08 2022] GET /identity/v3/projects/394d0e58e7e94b89a11bc5b1074deb4b => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:28:08.495146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:08.599059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44135583-07ac-4e78-8455-26f9b916a49b None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:08.635169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd40db-1d02-450f-9e86-aabd3ba662f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:08.635819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd40db-1d02-450f-9e86-aabd3ba662f4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:08.636100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd40db-1d02-450f-9e86-aabd3ba662f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:08.636372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd40db-1d02-450f-9e86-aabd3ba662f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:08.637097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd40db-1d02-450f-9e86-aabd3ba662f4 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=394d0e58e7e94b89a11bc5b1074deb4b, user.id=e8adbe813b5944a2ba96aa2048d6cad5) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:08.637403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd40db-1d02-450f-9e86-aabd3ba662f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:08.638854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd40db-1d02-450f-9e86-aabd3ba662f4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:08.645901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 586/1161] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:28:08 2022] GET /identity/v3/role_assignments?user.id=e8adbe813b5944a2ba96aa2048d6cad5&scope.project.id=394d0e58e7e94b89a11bc5b1074deb4b&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:10.639973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883fb3d-36aa-49f9-a1f2-8322d0d0c512 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:10.640503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883fb3d-36aa-49f9-a1f2-8322d0d0c512 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:10.640503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883fb3d-36aa-49f9-a1f2-8322d0d0c512 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:10.642321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 576/1162] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:10.650486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a68b0-93b9-4a74-a491-a89c16b4215a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:10.650915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a68b0-93b9-4a74-a491-a89c16b4215a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:10.651035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a68b0-93b9-4a74-a491-a89c16b4215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:10.678722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0d9a68b0-93b9-4a74-a491-a89c16b4215a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:10.680725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0d9a68b0-93b9-4a74-a491-a89c16b4215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:10.741392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:10.778613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 587/1163] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:11.054968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883fb3d-36aa-49f9-a1f2-8322d0d0c512 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:11.176127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883fb3d-36aa-49f9-a1f2-8322d0d0c512 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:11.219817 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:11.220424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:11.220703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:11.220970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:11.237875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:11.293376 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:11.294826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:11.408006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 577/1164] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:28:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:28:11.415094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a68b0-93b9-4a74-a491-a89c16b4215a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:11.521147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a68b0-93b9-4a74-a491-a89c16b4215a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:11.557204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4987f-4eed-4c26-b043-aca87541271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:11.557830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4987f-4eed-4c26-b043-aca87541271a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:11.558105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4987f-4eed-4c26-b043-aca87541271a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:11.558368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4987f-4eed-4c26-b043-aca87541271a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:11.565681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4987f-4eed-4c26-b043-aca87541271a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:11.567059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4987f-4eed-4c26-b043-aca87541271a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-92b4987f-4eed-4c26-b043-aca87541271a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:28:11.578991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:28:11.580202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:28:11.581394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 588/1165] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:28:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:28:11.587790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:11.645996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:11.709810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26df6c9-7b6b-4644-878f-7df5713c0b67 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:11.746884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbab064-ce89-4abd-987b-eb0b786125ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:11.747475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab064-ce89-4abd-987b-eb0b786125ee None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:11.747777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab064-ce89-4abd-987b-eb0b786125ee None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:11.748042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab064-ce89-4abd-987b-eb0b786125ee None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:11.748715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbab064-ce89-4abd-987b-eb0b786125ee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:11.749074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbab064-ce89-4abd-987b-eb0b786125ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:11.750434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbab064-ce89-4abd-987b-eb0b786125ee None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:11.757978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 578/1166] 10.222.0.88 () {56 vars in 1115 bytes} [Wed Aug 24 16:28:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:13.634258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694ccd-c374-4597-97d5-27b3fa6c1b63 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:13.635067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694ccd-c374-4597-97d5-27b3fa6c1b63 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:13.635067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52694ccd-c374-4597-97d5-27b3fa6c1b63 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:13.637294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 589/1167] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:13.642797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608208a4-b5a1-48ae-ac5b-c214985a10a6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:13.643227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608208a4-b5a1-48ae-ac5b-c214985a10a6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:13.643318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608208a4-b5a1-48ae-ac5b-c214985a10a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:13.662892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-608208a4-b5a1-48ae-ac5b-c214985a10a6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:13.664170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-608208a4-b5a1-48ae-ac5b-c214985a10a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:13.735466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 579/1168] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:14.001187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52694ccd-c374-4597-97d5-27b3fa6c1b63 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:14.039960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:14.115224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52694ccd-c374-4597-97d5-27b3fa6c1b63 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:14.151538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381fd3c-fa64-4598-8cd7-0e18b9b0656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:14.152182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381fd3c-fa64-4598-8cd7-0e18b9b0656b None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:14.152461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381fd3c-fa64-4598-8cd7-0e18b9b0656b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:14.152764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381fd3c-fa64-4598-8cd7-0e18b9b0656b None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:14.153422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381fd3c-fa64-4598-8cd7-0e18b9b0656b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:14.154810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381fd3c-fa64-4598-8cd7-0e18b9b0656b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:14.174363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 590/1169] 10.222.0.88 () {60 vars in 1138 bytes} [Wed Aug 24 16:28:14 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:28:16.083629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fad7-b3d8-4b3b-822f-feed0c6ddcc4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:16.084482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fad7-b3d8-4b3b-822f-feed0c6ddcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:16.084482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fad7-b3d8-4b3b-822f-feed0c6ddcc4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:16.086788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 580/1170] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:16.092986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449ed3-6f2c-4170-be60-4e9cc2796a4f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:16.093670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449ed3-6f2c-4170-be60-4e9cc2796a4f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:16.093795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449ed3-6f2c-4170-be60-4e9cc2796a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:16.116563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bd449ed3-6f2c-4170-be60-4e9cc2796a4f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:16.118339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bd449ed3-6f2c-4170-be60-4e9cc2796a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:16.197146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 591/1171] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:16.473226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8fad7-b3d8-4b3b-822f-feed0c6ddcc4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:16.522224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:16.586232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8fad7-b3d8-4b3b-822f-feed0c6ddcc4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:16.621853 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31961a30-564b-4859-97b6-cccc01ecfd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:16.622469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31961a30-564b-4859-97b6-cccc01ecfd0d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:16.622743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31961a30-564b-4859-97b6-cccc01ecfd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:16.623014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31961a30-564b-4859-97b6-cccc01ecfd0d None admin] PATH_INFO: `/v3/domains/2756320a0c4446d5b69167f5987d491e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:16.634889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31961a30-564b-4859-97b6-cccc01ecfd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=2756320a0c4446d5b69167f5987d491e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:16.636373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31961a30-564b-4859-97b6-cccc01ecfd0d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:16.637961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 581/1172] 10.222.0.88 () {56 vars in 1183 bytes} [Wed Aug 24 16:28:16 2022] GET /identity/v3/domains/2756320a0c4446d5b69167f5987d491e => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:16.644634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd449ed3-6f2c-4170-be60-4e9cc2796a4f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:16.668929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:16.753638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd449ed3-6f2c-4170-be60-4e9cc2796a4f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:16.792640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683317a7-84ae-4ae9-bbea-122bb48f8d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:16.793248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683317a7-84ae-4ae9-bbea-122bb48f8d4d None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:16.793525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683317a7-84ae-4ae9-bbea-122bb48f8d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:16.793794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683317a7-84ae-4ae9-bbea-122bb48f8d4d None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:16.794428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683317a7-84ae-4ae9-bbea-122bb48f8d4d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:16.795898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683317a7-84ae-4ae9-bbea-122bb48f8d4d None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:16.826870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 592/1173] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:28:16 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:28:18.759182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d136ce-160e-4543-9081-5fb4914c7248 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:18.760083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d136ce-160e-4543-9081-5fb4914c7248 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:18.760083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d136ce-160e-4543-9081-5fb4914c7248 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:18.762053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 582/1174] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:18.768516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c9b9-4a7e-4701-a570-218a74043712 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:18.768943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c9b9-4a7e-4701-a570-218a74043712 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:18.769297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c9b9-4a7e-4701-a570-218a74043712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:18.790127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-79f1c9b9-4a7e-4701-a570-218a74043712 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:18.791327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-79f1c9b9-4a7e-4701-a570-218a74043712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:18.862118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 593/1175] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:19.130639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d136ce-160e-4543-9081-5fb4914c7248 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:19.243801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:19.248420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d136ce-160e-4543-9081-5fb4914c7248 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:19.290254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f45e-3aed-4f76-8c7b-0ae001f2d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:19.290886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f45e-3aed-4f76-8c7b-0ae001f2d47a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:19.291170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f45e-3aed-4f76-8c7b-0ae001f2d47a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:19.291427 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f45e-3aed-4f76-8c7b-0ae001f2d47a None admin] PATH_INFO: `/v3/domains/2756320a0c4446d5b69167f5987d491e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:19.292808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36f45e-3aed-4f76-8c7b-0ae001f2d47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=2756320a0c4446d5b69167f5987d491e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:19.294269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36f45e-3aed-4f76-8c7b-0ae001f2d47a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:19.295904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 583/1176] 10.222.0.88 () {56 vars in 1183 bytes} [Wed Aug 24 16:28:19 2022] GET /identity/v3/domains/2756320a0c4446d5b69167f5987d491e => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:19.301981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1c9b9-4a7e-4701-a570-218a74043712 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:19.304289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:19.410211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1c9b9-4a7e-4701-a570-218a74043712 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:19.449991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dbdd8-07bc-447f-b740-96d65a981ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:19.450589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbdd8-07bc-447f-b740-96d65a981ace None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:19.450865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbdd8-07bc-447f-b740-96d65a981ace None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:19.451118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dbdd8-07bc-447f-b740-96d65a981ace None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:19.451786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dbdd8-07bc-447f-b740-96d65a981ace None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:19.453250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dbdd8-07bc-447f-b740-96d65a981ace None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:19.479735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 594/1177] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:28:19 2022] POST /identity/v3/users => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:28:21.403134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc9df-646f-4f06-a502-d1ee602c7762 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:21.404139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc9df-646f-4f06-a502-d1ee602c7762 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:21.404139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc9df-646f-4f06-a502-d1ee602c7762 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:21.406229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 584/1178] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:21.415220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1aab-69f8-4dcc-938e-9f5b458cd15b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:21.415678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1aab-69f8-4dcc-938e-9f5b458cd15b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:21.415810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe1aab-69f8-4dcc-938e-9f5b458cd15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:21.446025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5abe1aab-69f8-4dcc-938e-9f5b458cd15b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:21.447230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5abe1aab-69f8-4dcc-938e-9f5b458cd15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:21.506996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:21.523891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 595/1179] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:21.791318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc9df-646f-4f06-a502-d1ee602c7762 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:21.923268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc9df-646f-4f06-a502-d1ee602c7762 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:21.958951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:21.959562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:21.959871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:21.960141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:21.971025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:28:21.975620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:28:21.976781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:28:21.977991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 585/1180] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:28:21.985607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe1aab-69f8-4dcc-938e-9f5b458cd15b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:22.106656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe1aab-69f8-4dcc-938e-9f5b458cd15b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:22.142217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:22.142824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:22.143099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:22.143367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:22.144083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:22.144383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:22.145760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:22.154626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 596/1181] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:28:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:22.163880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:22.198882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:22.291673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7922588-fb2e-4809-abbd-de285b4fcbbf None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:22.329529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:22.330153 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:22.330528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:22.330783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] PATH_INFO: `/v3/users/b1071708e4f64c6c9a482529993075be` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:22.345144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] RBAC: Authorizing `identity:get_user(user_id=b1071708e4f64c6c9a482529993075be)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:22.346707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:22.348385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 586/1182] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:28:22 2022] GET /identity/v3/users/b1071708e4f64c6c9a482529993075be => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:22.355700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:22.416721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:22.467988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f65e5-f3d5-49d0-98c4-b1c6440c428c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:22.501885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:22.502493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:22.502773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:22.503044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:22.575082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:22.576586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:22.627270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:22.688786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 597/1183] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:28:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:28:22.696541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:22.786448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:22.803017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4fa3b-8d31-4fdb-84e2-1de581163617 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:22.841171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce479c-21ce-4c68-8a16-d76f088470bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:22.841802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce479c-21ce-4c68-8a16-d76f088470bd None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:22.842079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce479c-21ce-4c68-8a16-d76f088470bd None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:22.842347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce479c-21ce-4c68-8a16-d76f088470bd None admin] PATH_INFO: `/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:22.843483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce479c-21ce-4c68-8a16-d76f088470bd None admin] RBAC: Authorizing `identity:get_project(project_id=4639086d85374c3fb6ee68e0e4a29ac5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:22.844960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce479c-21ce-4c68-8a16-d76f088470bd None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:22.846591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 587/1184] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:28:22 2022] GET /identity/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:22.855271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:22.959929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5373b-e76b-4b68-9751-83f902eab0ac None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:23.000463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cab27-edd2-42fe-b490-a7417893a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:23.001061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cab27-edd2-42fe-b490-a7417893a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:23.001347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cab27-edd2-42fe-b490-a7417893a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:23.001616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cab27-edd2-42fe-b490-a7417893a5d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:23.002341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cab27-edd2-42fe-b490-a7417893a5d8 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=4639086d85374c3fb6ee68e0e4a29ac5, user.id=b1071708e4f64c6c9a482529993075be) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:23.002651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cab27-edd2-42fe-b490-a7417893a5d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:23.004474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cab27-edd2-42fe-b490-a7417893a5d8 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:23.010652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 598/1185] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:28:22 2022] GET /identity/v3/role_assignments?user.id=b1071708e4f64c6c9a482529993075be&scope.project.id=4639086d85374c3fb6ee68e0e4a29ac5&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:24.882036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaedebe-d208-40f9-9931-ed3ae086f8ac None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:24.882625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaedebe-d208-40f9-9931-ed3ae086f8ac None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:24.882625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaedebe-d208-40f9-9931-ed3ae086f8ac None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:24.883996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 588/1186] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:24.890418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463e6b-b7e3-4e95-a03e-dc2d9039d3e9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:24.891135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463e6b-b7e3-4e95-a03e-dc2d9039d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:24.891353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463e6b-b7e3-4e95-a03e-dc2d9039d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:24.914178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-22463e6b-b7e3-4e95-a03e-dc2d9039d3e9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:24.915388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-22463e6b-b7e3-4e95-a03e-dc2d9039d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:24.925022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:24.988611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 599/1187] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:25.264101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaedebe-d208-40f9-9931-ed3ae086f8ac None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:25.395671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaedebe-d208-40f9-9931-ed3ae086f8ac None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:25.433866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:25.434487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:25.434774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:25.435045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:25.446896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:28:25.451541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:28:25.452581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:25.453574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:28:25.455761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 589/1188] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:28:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:28:25.459318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463e6b-b7e3-4e95-a03e-dc2d9039d3e9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:25.562856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463e6b-b7e3-4e95-a03e-dc2d9039d3e9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:25.604060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:25.604676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:25.604955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:25.605227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:25.605890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:25.606193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:25.607625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:25.616630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 600/1189] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:25.622954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:25.640614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:25.734224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fff74c-5222-40eb-8468-cc83efe642d1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:25.770993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:25.771627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:25.771920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:25.772196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] PATH_INFO: `/v3/users/b1071708e4f64c6c9a482529993075be` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:25.773493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] RBAC: Authorizing `identity:get_user(user_id=b1071708e4f64c6c9a482529993075be)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:25.774954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:25.776569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 590/1190] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:28:25 2022] GET /identity/v3/users/b1071708e4f64c6c9a482529993075be => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:25.782720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:25.793238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:25.894365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b71dbe-b712-4193-b01e-75232ccbaa8c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:25.930404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7fb88-fa5a-4eb9-8d9c-3e2f1c261513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:25.931029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7fb88-fa5a-4eb9-8d9c-3e2f1c261513 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:25.931308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7fb88-fa5a-4eb9-8d9c-3e2f1c261513 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:25.931604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7fb88-fa5a-4eb9-8d9c-3e2f1c261513 None admin] PATH_INFO: `/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:25.932855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7fb88-fa5a-4eb9-8d9c-3e2f1c261513 None admin] RBAC: Authorizing `identity:get_project(project_id=4639086d85374c3fb6ee68e0e4a29ac5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:25.934306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7fb88-fa5a-4eb9-8d9c-3e2f1c261513 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:25.935987 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 601/1191] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:28:25 2022] GET /identity/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:25.942305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:26.046678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:26.066415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726772-2c64-4487-b9f5-28bf4e29935e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:26.108188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6528af7-8d37-45ac-93b6-6124bb8efd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:26.108851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528af7-8d37-45ac-93b6-6124bb8efd51 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:26.109130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528af7-8d37-45ac-93b6-6124bb8efd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:26.109385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6528af7-8d37-45ac-93b6-6124bb8efd51 None admin] PATH_INFO: `/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5/users/b1071708e4f64c6c9a482529993075be/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:26.111569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6528af7-8d37-45ac-93b6-6124bb8efd51 None admin] RBAC: Authorizing `identity:create_grant(project_id=4639086d85374c3fb6ee68e0e4a29ac5, user_id=b1071708e4f64c6c9a482529993075be, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:26.113057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6528af7-8d37-45ac-93b6-6124bb8efd51 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:26.133689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 591/1192] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:28:25 2022] PUT /identity/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5/users/b1071708e4f64c6c9a482529993075be/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:28:28.005750 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6807ea-ed0a-4ad2-8a82-b87f26c961ce None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:28.006338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6807ea-ed0a-4ad2-8a82-b87f26c961ce None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:28.006338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6807ea-ed0a-4ad2-8a82-b87f26c961ce None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:28.007689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 602/1193] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:28:28.016738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0005-488e-4687-b3f9-2fba7947241f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:28.017443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0005-488e-4687-b3f9-2fba7947241f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:28.017618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e0005-488e-4687-b3f9-2fba7947241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:28.040455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bf0e0005-488e-4687-b3f9-2fba7947241f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:28:28.041666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bf0e0005-488e-4687-b3f9-2fba7947241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:28:28.116211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 592/1194] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:28:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:28:28.376031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6807ea-ed0a-4ad2-8a82-b87f26c961ce None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:28.466435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:28.496888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6807ea-ed0a-4ad2-8a82-b87f26c961ce None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:28.532436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:28.533055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:28.533323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:28.533591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:28.544750 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:28:28.549324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:28:28.551671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:28:28.552684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 603/1195] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:28:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:28:28.557491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e0005-488e-4687-b3f9-2fba7947241f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:28.638739 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:28.677539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e0005-488e-4687-b3f9-2fba7947241f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:28.713072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:28.713664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:28.713941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:28.714212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:28.714855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:28.715148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:28.716558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:28.724409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 593/1196] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:28.730555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:28.835711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90386-fd9b-4caf-a211-f63cf20beed9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:28.870988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:28.871611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:28.871899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:28.872163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] PATH_INFO: `/v3/users/b1071708e4f64c6c9a482529993075be` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:28.873381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] RBAC: Authorizing `identity:get_user(user_id=b1071708e4f64c6c9a482529993075be)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:28.874900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:28.876533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 604/1197] 10.222.0.88 () {56 vars in 1177 bytes} [Wed Aug 24 16:28:28 2022] GET /identity/v3/users/b1071708e4f64c6c9a482529993075be => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:28.884606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:29.008835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4e7e-3cf9-4f84-90cf-7ab91b2ee1d1 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:29.048533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:29.049575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:29.049958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:29.050400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:29.055148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:29.135420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:29.136942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:29.255785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 594/1198] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:28:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:28:29.258260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:29.262725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:29.375564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9434ff-32f6-432d-979a-a74742a61c70 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:29.413255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae44a-0f27-4f58-b434-f35ad54bc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:29.413961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae44a-0f27-4f58-b434-f35ad54bc332 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:29.414272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae44a-0f27-4f58-b434-f35ad54bc332 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:29.414506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae44a-0f27-4f58-b434-f35ad54bc332 None admin] PATH_INFO: `/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:29.415770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ae44a-0f27-4f58-b434-f35ad54bc332 None admin] RBAC: Authorizing `identity:get_project(project_id=4639086d85374c3fb6ee68e0e4a29ac5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:29.417218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ae44a-0f27-4f58-b434-f35ad54bc332 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:29.418908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 605/1199] 10.222.0.88 () {56 vars in 1186 bytes} [Wed Aug 24 16:28:29 2022] GET /identity/v3/projects/4639086d85374c3fb6ee68e0e4a29ac5 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:29.426199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:28:29.463854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:29.549241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7049b3-aeea-4051-ad12-6529c9fbb911 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:28:29.584904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4e85-0560-427e-b8d1-9c4ba50ec436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:28:29.585557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4e85-0560-427e-b8d1-9c4ba50ec436 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:28:29.585882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4e85-0560-427e-b8d1-9c4ba50ec436 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:28:29.586158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4e85-0560-427e-b8d1-9c4ba50ec436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:28:29.586887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4e85-0560-427e-b8d1-9c4ba50ec436 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=4639086d85374c3fb6ee68e0e4a29ac5, user.id=b1071708e4f64c6c9a482529993075be) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:28:29.587196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4e85-0560-427e-b8d1-9c4ba50ec436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:28:29.588653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4e85-0560-427e-b8d1-9c4ba50ec436 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:28:29.594695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 595/1200] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:28:29 2022] GET /identity/v3/role_assignments?user.id=b1071708e4f64c6c9a482529993075be&scope.project.id=4639086d85374c3fb6ee68e0e4a29ac5&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:28:39.407930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=65 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:28:39.592060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=51 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:25.577013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44f51-d369-4c31-86b1-2a8eeec3a30f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:25.577013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44f51-d369-4c31-86b1-2a8eeec3a30f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:25.577013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc44f51-d369-4c31-86b1-2a8eeec3a30f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:25.578006 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 606/1201] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:29:25.584303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbffd13-7505-45a2-a569-42d7f1a7dccb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:25.584830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbffd13-7505-45a2-a569-42d7f1a7dccb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:25.584830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbffd13-7505-45a2-a569-42d7f1a7dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:25.605432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ddbffd13-7505-45a2-a569-42d7f1a7dccb None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:25.607624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ddbffd13-7505-45a2-a569-42d7f1a7dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:25.685701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 596/1202] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:25.962803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44f51-d369-4c31-86b1-2a8eeec3a30f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:26.101149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc44f51-d369-4c31-86b1-2a8eeec3a30f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:26.150593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:26.151282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:26.151557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:26.151864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:26.165464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:26.167078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:26.186984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:26.188285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:26.189402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:26.189402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:26.189402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:26.189402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 607/1203] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:26.194784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbffd13-7505-45a2-a569-42d7f1a7dccb None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:26.320327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbffd13-7505-45a2-a569-42d7f1a7dccb None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:26.354781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:26.362681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc44ca-6162-4e45-b6dd-a5126d1fe297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:26.363426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc44ca-6162-4e45-b6dd-a5126d1fe297 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:26.363997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc44ca-6162-4e45-b6dd-a5126d1fe297 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:26.364306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc44ca-6162-4e45-b6dd-a5126d1fe297 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:26.365096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc44ca-6162-4e45-b6dd-a5126d1fe297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:26.365436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc44ca-6162-4e45-b6dd-a5126d1fe297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:26.367075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc44ca-6162-4e45-b6dd-a5126d1fe297 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:26.380727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 597/1204] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:26.387189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:26.458888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:26.538888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfaa44-f6d1-4369-86a0-1486c768d816 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:26.580982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba58336-db53-441b-b539-b1f954bc74d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:26.582274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba58336-db53-441b-b539-b1f954bc74d5 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:26.582741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba58336-db53-441b-b539-b1f954bc74d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:26.583160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba58336-db53-441b-b539-b1f954bc74d5 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:26.583985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba58336-db53-441b-b539-b1f954bc74d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:26.585708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba58336-db53-441b-b539-b1f954bc74d5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:26.615481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 608/1205] 10.222.0.88 () {60 vars in 1132 bytes} [Wed Aug 24 16:29:26 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:29:28.794488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dac4a-067d-4723-8827-7ccaaef6a393 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:28.795024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dac4a-067d-4723-8827-7ccaaef6a393 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:28.795024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dac4a-067d-4723-8827-7ccaaef6a393 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:28.796253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 598/1206] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:29:28.805649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c778-5377-47bc-a126-432f152c3631 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:28.805649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c778-5377-47bc-a126-432f152c3631 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:28.805649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c778-5377-47bc-a126-432f152c3631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:28.823110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9f23c778-5377-47bc-a126-432f152c3631 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:28.824402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9f23c778-5377-47bc-a126-432f152c3631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:28.900313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 609/1207] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:29.186884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dac4a-067d-4723-8827-7ccaaef6a393 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:29.318638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dac4a-067d-4723-8827-7ccaaef6a393 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:29.369245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:29.369952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:29.370233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:29.370507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:29.381714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:29:29.386940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:29.388096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:29.388965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 599/1208] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:29:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:29:29.394245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23c778-5377-47bc-a126-432f152c3631 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:29.437258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:29.509986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23c778-5377-47bc-a126-432f152c3631 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:29.544647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:29.545355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:29.545716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:29.545994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:29.546710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:29.547074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:29.548618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:29.558535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 610/1209] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:29:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:29:29.564558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:29.626814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:29.681782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812f8a2-67af-4a3c-8695-058a1cac8a90 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:29.726875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:29.727594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:29.727958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:29.728410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:29.741331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:29.743021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:29.762420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:29.763649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:29.764569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:29.764569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:29.764569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:29.767729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 600/1210] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:29:29.770268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:29.891985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:29.895341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382959fc-785f-4c33-b5bf-f62e399c8f18 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:29.935629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:29.936513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:29.936933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:29.937335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:29.938127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:29.938427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:29.939910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:29.953370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 611/1211] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:29.959160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:30.077545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82590d5-92cb-42f5-8653-83e7f4ac4dd3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:30.079561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:30.121316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:30.121953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:30.122205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:30.122470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:30.131395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:30.132967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:29:30.145839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:30.148646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:30.149676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 601/1212] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:30.153371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:30.296368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195900ec-e15a-42b9-a872-f3ed145a51fc None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:30.343453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:30.343453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:30.343453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:30.343453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:30.345392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:30.345392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:30.345905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:30.371689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 612/1213] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 16:29:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:29:30.378201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:30.505678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49934a1e-1b20-41de-aef5-e30bad684cd7 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:30.548790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:30.549582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:30.550005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:30.550401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:30.586639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:30.632682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:30.634942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:30.763243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 602/1214] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:29:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:29:30.764831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:30.791109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:30.888526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad061b6-4764-4bd0-bfe1-e6d08d09f285 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:30.927962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:30.928641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:30.928937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:30.929176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:30.941694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:30.943342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:30.960184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:30.961815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:30.963397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:30.963397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:30.963397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:30.963397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 613/1215] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:30.968428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:31.032973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:31.075109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983e77a-f98e-421a-bb9c-d2486025508a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:31.122489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:31.123120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:31.125418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:31.125418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:31.125418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:31.125418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:31.126060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:31.139433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 603/1216] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:31.148543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:31.222893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:31.257556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460b61-726f-4f75-8b28-2a838f9247d4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:31.298843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:31.300105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:31.300461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:31.300802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:31.310474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:31.312392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:29:31.324093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:31.325217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:31.326369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:31.331963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 614/1217] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:31.333509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:31.449679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701db4b-2270-418f-9c9d-cd8db9170a0a None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:31.481736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:31.496542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfee669-089b-496d-b9ff-e9eabd6524ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:31.497325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfee669-089b-496d-b9ff-e9eabd6524ed None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:31.497760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfee669-089b-496d-b9ff-e9eabd6524ed None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:31.498084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfee669-089b-496d-b9ff-e9eabd6524ed None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:31.498917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfee669-089b-496d-b9ff-e9eabd6524ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:31.499322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfee669-089b-496d-b9ff-e9eabd6524ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:31.501015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfee669-089b-496d-b9ff-e9eabd6524ed None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:31.514887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 604/1218] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:31.521549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:31.638325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa204589-f721-4b73-a1f2-e14a7e776699 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:31.672065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:31.677838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bac44-a3f4-4601-a6fb-975d4897f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:31.678487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bac44-a3f4-4601-a6fb-975d4897f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:31.678749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bac44-a3f4-4601-a6fb-975d4897f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:31.679021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bac44-a3f4-4601-a6fb-975d4897f4d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:31.679775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bac44-a3f4-4601-a6fb-975d4897f4d4 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=d8fe69ee335b461fbfa55620f104beb3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:31.680274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bac44-a3f4-4601-a6fb-975d4897f4d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:31.682183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bac44-a3f4-4601-a6fb-975d4897f4d4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:31.688075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 615/1219] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:29:31 2022] GET /identity/v3/role_assignments?user.id=d8fe69ee335b461fbfa55620f104beb3&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:33.746223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa482-b440-4aee-8f25-d6bee2f3556f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:33.746756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa482-b440-4aee-8f25-d6bee2f3556f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:33.746756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa482-b440-4aee-8f25-d6bee2f3556f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:33.748250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 605/1220] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:29:33.753895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d7a3-cddb-4444-8169-2a2b57c0b50b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:33.754396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d7a3-cddb-4444-8169-2a2b57c0b50b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:33.754600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05d7a3-cddb-4444-8169-2a2b57c0b50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:33.776538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7d05d7a3-cddb-4444-8169-2a2b57c0b50b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:33.777963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7d05d7a3-cddb-4444-8169-2a2b57c0b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:33.854647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 616/1221] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:34.137498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fa482-b440-4aee-8f25-d6bee2f3556f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:34.253577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fa482-b440-4aee-8f25-d6bee2f3556f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:34.297647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462f26-b75f-457f-aa78-0092841634db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:34.298273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462f26-b75f-457f-aa78-0092841634db None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:34.298548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462f26-b75f-457f-aa78-0092841634db None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:34.298816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be462f26-b75f-457f-aa78-0092841634db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:34.312708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be462f26-b75f-457f-aa78-0092841634db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-be462f26-b75f-457f-aa78-0092841634db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:29:34.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:34.318034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:34.319063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 606/1222] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:34.324664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05d7a3-cddb-4444-8169-2a2b57c0b50b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:34.433270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05d7a3-cddb-4444-8169-2a2b57c0b50b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:34.460255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:34.474041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:34.474736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:34.475022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:34.475311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:34.476058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:34.476354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:34.477835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:34.486362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 617/1223] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:34.492241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462f26-b75f-457f-aa78-0092841634db None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:34.537851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:34.599292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be462f26-b75f-457f-aa78-0092841634db None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:34.636605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:34.637248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:34.637504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:34.637772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:34.648515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:34.650146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:34.665599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:34.666987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:34.668132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:34.668132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:34.668132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:34.668666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 607/1224] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:34.674669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:34.789223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c45a0-eb25-43cf-b286-c21cf5365b4a None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:34.823762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:34.824396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:34.824756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:34.825059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:34.825739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:34.826046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:34.827556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:34.841223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 618/1225] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:34.847737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:34.954030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:34.961527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45aaad-9afd-4d6c-9898-a59c8f995d2d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:34.997661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:34.998301 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:34.998598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:34.998869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:35.007566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:35.009183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:29:35.020097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:35.021172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:35.022262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 608/1226] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:35.027439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:35.080200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:35.138739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0daa-b3cd-4777-b48f-6c0be12ab517 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:35.178441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:35.179060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:35.179335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:35.179632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:35.180388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:35.180684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:35.182272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:35.201125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 619/1227] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 16:29:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:35.207373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:35.321571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb3d32-1359-4d71-b9d5-657de33ad849 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:35.364161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:35.364750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:35.365138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:35.365408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:35.377978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:35.379489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:35.394753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:35.396135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:35.397425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:35.397425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:35.397425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:35.400982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 609/1228] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:35.402449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:35.517744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497f5ee-8bf2-4abd-b033-743f02c59a3c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:35.520173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:35.557291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:35.557903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:35.558178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:35.558488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:35.559127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:35.559421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:35.560826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:35.575870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 620/1229] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:35.579027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:35.590068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:35.709404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53eec4-a6c5-4b18-88a8-d4cf77da715d None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:35.751932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:35.752616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:35.752899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:35.753187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:35.761444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:35.762909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:29:35.778054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:35.779065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:35.779980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 610/1230] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:29:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:35.786128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:35.895935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3369-95c7-4f4c-9c20-396686b00eb9 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:35.932356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649272-64b5-4194-bc85-fb98a0f1b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:35.933018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649272-64b5-4194-bc85-fb98a0f1b941 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:35.933333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649272-64b5-4194-bc85-fb98a0f1b941 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:35.933631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649272-64b5-4194-bc85-fb98a0f1b941 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:35.934386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649272-64b5-4194-bc85-fb98a0f1b941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:35.934767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649272-64b5-4194-bc85-fb98a0f1b941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:35.936328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649272-64b5-4194-bc85-fb98a0f1b941 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:35.951751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 621/1231] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:29:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:35.958021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:36.032113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:36.068845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a905ee-288b-45af-b542-96f3e049dd8e None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:36.103886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f99a07-ffaa-4a26-bd7f-37e2f4958d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:36.104589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99a07-ffaa-4a26-bd7f-37e2f4958d81 None admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:36.104804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99a07-ffaa-4a26-bd7f-37e2f4958d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:36.105084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f99a07-ffaa-4a26-bd7f-37e2f4958d81 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/d8fe69ee335b461fbfa55620f104beb3/roles/8bece968e0a344968a91eab1247ced88` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:36.120064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f99a07-ffaa-4a26-bd7f-37e2f4958d81 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=d8fe69ee335b461fbfa55620f104beb3, role_id=8bece968e0a344968a91eab1247ced88)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:36.121467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f99a07-ffaa-4a26-bd7f-37e2f4958d81 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:36.135405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 611/1232] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:29:35 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/d8fe69ee335b461fbfa55620f104beb3/roles/8bece968e0a344968a91eab1247ced88 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:29:38.153548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c3277-9b31-4c7c-9895-4f80b334230a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:38.154164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c3277-9b31-4c7c-9895-4f80b334230a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:38.154164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c3277-9b31-4c7c-9895-4f80b334230a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:38.155554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 622/1233] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:29:38.161848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c250-b6ab-4773-aa93-9c369b88b5c4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:38.162349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c250-b6ab-4773-aa93-9c369b88b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:38.162445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c250-b6ab-4773-aa93-9c369b88b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:38.182123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4f22c250-b6ab-4773-aa93-9c369b88b5c4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:38.183318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4f22c250-b6ab-4773-aa93-9c369b88b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:38.258326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 612/1234] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:38.531928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c3277-9b31-4c7c-9895-4f80b334230a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:38.558195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:38.641916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c3277-9b31-4c7c-9895-4f80b334230a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:38.675975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:38.676621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:38.676886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:38.677154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:38.687375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:29:38.692253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:38.693394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:38.694312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 623/1235] 10.222.0.88 () {56 vars in 1102 bytes} [Wed Aug 24 16:29:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:38.700505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22c250-b6ab-4773-aa93-9c369b88b5c4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:38.752031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:38.807959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22c250-b6ab-4773-aa93-9c369b88b5c4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:38.847463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:38.848109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:38.848398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:38.848656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:38.849316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:38.849631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:38.851003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:38.859385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 613/1236] 10.222.0.88 () {56 vars in 1103 bytes} [Wed Aug 24 16:29:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:38.865299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:38.960324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:38.981400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424f501-2dcc-4a58-8262-64d4cac18c68 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:39.019378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:39.020062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:39.020336 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:39.020600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:39.031774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:39.033279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:39.048305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:39.049560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:39.050566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:39.050566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:39.050566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:39.050566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 624/1237] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:29:39.055543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:39.167679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7336f6-aacf-40db-b260-8368987ab7b3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:39.177948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:39.204954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:39.205651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:39.205839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:39.206148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:39.206925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:39.207297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:39.208815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:39.222321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 614/1238] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:39.228326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:39.334657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1334c-c90a-4bca-a278-cc1bb3f3c631 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:39.373346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:39.374136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:39.374477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:39.374775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:39.378328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:39.385771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:39.387402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:29:39.399103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:39.400635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:39.401827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 625/1239] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:39.409579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:39.532330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc28303-1abc-436b-8dfb-763243b403c9 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:39.569938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:39.570605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:39.570885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:39.571183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:39.572184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:39.572469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:39.574032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:39.592584 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 615/1240] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 16:29:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:39.598991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:39.715471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221bfb3-86a7-4b37-aab8-353c494aedc4 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:39.759160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:39.759840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:39.760116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:39.760389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:39.835221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:39.846426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:39.849175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:39.985341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 626/1241] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:29:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:29:39.992019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:40.022968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:40.105608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37c07-0f06-4889-89a0-4e352dc69c7f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:40.150261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:40.151151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:40.151502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:40.151897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:40.163474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:40.165449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:40.181364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:40.183244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:40.184460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:40.184460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:40.184460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:40.184460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 616/1242] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:40.188627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:40.288227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:40.294719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab7825-9486-4ea4-a128-895b012ac771 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:40.332848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:40.333668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:40.334089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:40.334415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:40.335082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:40.335422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:40.337155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:40.350754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 627/1243] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:40.357021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:40.441605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:40.467612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f35eb-b74e-418a-a15b-3facb9a3ae07 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:40.511266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:40.511994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:40.512479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:40.512793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:40.520666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:40.522340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:29:40.535879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:40.537085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:40.538053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 617/1244] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:29:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:40.544316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:40.662017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11fc32-2f77-495e-95dd-7824025527fe None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:40.702934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c412c0-26ad-4e41-b374-b40e93e25e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:40.703789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c412c0-26ad-4e41-b374-b40e93e25e0a None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:40.703927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c412c0-26ad-4e41-b374-b40e93e25e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:40.704577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c412c0-26ad-4e41-b374-b40e93e25e0a None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:40.705410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c412c0-26ad-4e41-b374-b40e93e25e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:40.705873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c412c0-26ad-4e41-b374-b40e93e25e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:40.707842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c412c0-26ad-4e41-b374-b40e93e25e0a None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:40.728245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 628/1245] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:40.734307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:40.847689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1f04-9318-4d5c-9563-5d03e1630669 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:40.882730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467d835-5564-42dd-91a0-c35e06fb5cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:40.883340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d835-5564-42dd-91a0-c35e06fb5cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:40.883693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d835-5564-42dd-91a0-c35e06fb5cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:40.883973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d835-5564-42dd-91a0-c35e06fb5cb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:40.884770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d835-5564-42dd-91a0-c35e06fb5cb3 None admin] RBAC: Adding query filter params (role.id=8bece968e0a344968a91eab1247ced88, scope.project.id=f928809858b64247862a3901925f8a43, user.id=d8fe69ee335b461fbfa55620f104beb3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:40.884999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d835-5564-42dd-91a0-c35e06fb5cb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:40.886421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d835-5564-42dd-91a0-c35e06fb5cb3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:40.892341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 618/1246] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:29:40 2022] GET /identity/v3/role_assignments?user.id=d8fe69ee335b461fbfa55620f104beb3&scope.project.id=f928809858b64247862a3901925f8a43&role.id=8bece968e0a344968a91eab1247ced88 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:29:42.951278 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb98d7-412a-49fa-bea5-66a7492ae2f3 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:42.951850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb98d7-412a-49fa-bea5-66a7492ae2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:42.951850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb98d7-412a-49fa-bea5-66a7492ae2f3 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:42.953195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 629/1247] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:29:42.958673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eac30-6dd5-41f8-a4de-4440aa4dba3c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:42.959224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eac30-6dd5-41f8-a4de-4440aa4dba3c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:42.959224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eac30-6dd5-41f8-a4de-4440aa4dba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:42.965831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:42.979726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-136eac30-6dd5-41f8-a4de-4440aa4dba3c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:42.981000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-136eac30-6dd5-41f8-a4de-4440aa4dba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:43.056908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 619/1248] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:43.325017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb98d7-412a-49fa-bea5-66a7492ae2f3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:43.349313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:43.442580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb98d7-412a-49fa-bea5-66a7492ae2f3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:43.482183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:43.482833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:43.483121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:43.483389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:43.494523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:29:43.499272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:43.500470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:43.501427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 630/1249] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:43.507303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eac30-6dd5-41f8-a4de-4440aa4dba3c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:43.632117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eac30-6dd5-41f8-a4de-4440aa4dba3c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:43.665469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:43.672279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:43.672906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:43.673198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:43.673455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:43.674132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:43.674430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:43.675829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:43.685295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 620/1250] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:43.692012 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:43.784309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:43.816545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7849a-c343-4e4e-b822-86e0c6fd0e2f None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:43.852930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:43.853636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:43.853956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:43.854227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:43.865399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:43.866853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:43.883307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:43.891119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:43.892330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:43.892330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:43.892330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:43.892330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 631/1251] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:43.893176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:44.001738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517fc9-a825-4cd3-94ed-0c45b924a33f None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:44.038143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:44.038757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:44.039039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:44.039316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:44.040077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:44.041106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:44.042617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:44.056140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 621/1252] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:44.062430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:44.181144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f31bbd-9301-4bb4-bdac-5b337d2f42ef None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:44.209875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:44.218482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:44.219126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:44.219400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:44.219704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:44.228043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:44.229540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:29:44.240814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:44.241909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:44.242864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 632/1253] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:44.248540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:44.312593 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:44.363989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6cbc3-a9ae-40eb-aaeb-bd8d9392f331 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:44.406652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:44.408247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:44.408508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:44.408805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:44.409659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:44.409983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:44.411627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:44.431663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 622/1254] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 16:29:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:44.437776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:44.567135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7e8d8-e4ec-4e3a-a104-453a4142076c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:44.605473 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:44.606088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:44.606449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:44.606773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:44.668213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:44.682090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:44.683491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:44.802564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 633/1255] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:29:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:29:44.809570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:44.920953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc414-9a04-4d72-85c2-1f629bc9867b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:44.935851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:44.959699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:44.960407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:44.960682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:44.960985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:44.974505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:44.976073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:44.992883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:44.993956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:44.994919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:44.994919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:44.994919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:44.994919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 623/1256] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:45.001128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:45.108491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:45.123202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6194f-fc3b-41b4-b1b6-6ea02cf9d6ae None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:45.161231 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:45.162135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:45.162404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:45.162673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:45.163311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:45.165075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:45.165075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:45.178396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 634/1257] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:45.185033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:45.300358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12209e-5d4f-4ccd-a1e6-edf651f87608 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:45.348833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:45.349650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:45.349966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:45.350305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:45.358958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:45.360618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:29:45.372718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:45.373970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:45.375151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 624/1258] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:45.382354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:45.494903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f7ba-a316-4f21-8a6f-d91287fa9035 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:45.532720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c63d2-6917-40c9-9eab-304890e9eeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:45.533315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c63d2-6917-40c9-9eab-304890e9eeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:45.533591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c63d2-6917-40c9-9eab-304890e9eeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:45.533855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c63d2-6917-40c9-9eab-304890e9eeb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:45.534534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c63d2-6917-40c9-9eab-304890e9eeb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:45.534853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c63d2-6917-40c9-9eab-304890e9eeb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:45.536327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c63d2-6917-40c9-9eab-304890e9eeb5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:45.549340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 635/1259] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:45.555676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:45.586575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:45.665004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245495b-de56-498b-928d-f98fa2baaa3c None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:45.700761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73e238-7308-43b2-84e5-1793db038650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:45.701332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e238-7308-43b2-84e5-1793db038650 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:45.701610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e238-7308-43b2-84e5-1793db038650 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:45.701876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e238-7308-43b2-84e5-1793db038650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:45.702610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73e238-7308-43b2-84e5-1793db038650 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f928809858b64247862a3901925f8a43, user.id=d8fe69ee335b461fbfa55620f104beb3) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:45.702908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73e238-7308-43b2-84e5-1793db038650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:45.704526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73e238-7308-43b2-84e5-1793db038650 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:45.710611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 625/1260] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:29:45 2022] GET /identity/v3/role_assignments?user.id=d8fe69ee335b461fbfa55620f104beb3&scope.project.id=f928809858b64247862a3901925f8a43&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:47.586339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3689d-7086-4648-a953-443af2cb49dc None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:47.587160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3689d-7086-4648-a953-443af2cb49dc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:47.587160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3689d-7086-4648-a953-443af2cb49dc None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:47.590365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 636/1261] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:29:47.599334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17becf-fdc8-4c6d-92ab-0f14910cf7ef None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:47.600107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17becf-fdc8-4c6d-92ab-0f14910cf7ef None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:47.600259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17becf-fdc8-4c6d-92ab-0f14910cf7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:47.622212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7b17becf-fdc8-4c6d-92ab-0f14910cf7ef None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:47.623399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7b17becf-fdc8-4c6d-92ab-0f14910cf7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:47.717777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 626/1262] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:47.984261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3689d-7086-4648-a953-443af2cb49dc None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:47.996977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:48.115921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3689d-7086-4648-a953-443af2cb49dc None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:48.157240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:48.157928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:48.158128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:48.158418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:48.170823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:29:48.175485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:48.176606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:48.178151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 637/1263] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:48.185065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17becf-fdc8-4c6d-92ab-0f14910cf7ef None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:48.204587 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:48.292510 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17becf-fdc8-4c6d-92ab-0f14910cf7ef None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:48.333807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:48.334695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:48.335077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:48.335440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:48.336493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:48.336921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:48.339062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:48.352016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 627/1264] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:29:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:29:48.358333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:48.438268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:48.473907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c5ff6-6fd1-4d04-8eaf-18b50a3a2330 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:48.517605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:48.518221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:48.518495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:48.518761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:48.529534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:48.530998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:48.546210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:48.547227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:48.548330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:48.548330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:48.548330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:48.548330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 638/1265] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:48.553349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:48.643402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:48.665025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f5b4-6853-46d9-84a8-1d165c66ce9b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:48.703092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:48.703752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:48.704036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:48.704309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:48.704964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:48.705296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:48.706658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:48.719909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 628/1266] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:48.726144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:48.840240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a74dbd-69e7-4a13-89b1-2c3a1a88aee3 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:48.859622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:48.875884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:48.876515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:48.876786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:48.877018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:48.885505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:48.886955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:29:48.898011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:48.899153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:48.900285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 639/1267] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:48.905497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:49.011163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fd30c-d797-4c5d-8dd7-034faf0a3654 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:49.050543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:49.051433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:49.051832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:49.052194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:49.053286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:49.053692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:49.056050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:49.066329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:49.075977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 629/1268] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 16:29:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:49.082503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:49.197018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c1de9-6170-4f7a-a1a4-747d8e4e08e6 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:49.232264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:49.232886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:49.233165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:49.233438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:49.244375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:49.245835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:49.260009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:49.261111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:49.262442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:49.262442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:49.262442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:49.262442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 640/1269] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:49.267325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:49.380757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3153d5-10d3-43a1-bee8-0de03c52cff0 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:49.417174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:49.417802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:49.418061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:49.418334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:49.418964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:49.419277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:49.420984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:49.433204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 630/1270] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:49.439271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:49.473303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:49.545483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82489c0-1a82-445f-a2e9-65167b2904b2 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:49.581093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:49.581719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:49.581999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:49.582270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:49.589535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:49.590989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:29:49.602380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:49.603295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:49.604298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 641/1271] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:49.610486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:49.681363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:49.731070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11a0e7-70c2-49b9-ab60-450930297fb3 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:49.768220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716163d7-14f1-4c41-840e-36d95b069b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:49.768821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716163d7-14f1-4c41-840e-36d95b069b61 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:49.769108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716163d7-14f1-4c41-840e-36d95b069b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:49.769373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716163d7-14f1-4c41-840e-36d95b069b61 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:49.770059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716163d7-14f1-4c41-840e-36d95b069b61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:49.770365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716163d7-14f1-4c41-840e-36d95b069b61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:49.771842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716163d7-14f1-4c41-840e-36d95b069b61 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:49.785185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 631/1272] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:49.794853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:49.914184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:49.924369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf905c1-f713-410e-8cb8-d72006743a89 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:49.962651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb72a-787b-4143-bca4-581a0051d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:49.963223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb72a-787b-4143-bca4-581a0051d1b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:49.963499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb72a-787b-4143-bca4-581a0051d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:49.963800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb72a-787b-4143-bca4-581a0051d1b5 None admin] PATH_INFO: `/v3/projects/f928809858b64247862a3901925f8a43/users/d8fe69ee335b461fbfa55620f104beb3/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:49.965813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb72a-787b-4143-bca4-581a0051d1b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f928809858b64247862a3901925f8a43, user_id=d8fe69ee335b461fbfa55620f104beb3, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:49.967264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb72a-787b-4143-bca4-581a0051d1b5 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:49.982691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 642/1273] 10.222.0.88 () {58 vars in 1439 bytes} [Wed Aug 24 16:29:49 2022] PUT /identity/v3/projects/f928809858b64247862a3901925f8a43/users/d8fe69ee335b461fbfa55620f104beb3/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:29:51.926122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cd9d7-1d88-4bcd-836d-102c1e6cb84e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:51.926932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cd9d7-1d88-4bcd-836d-102c1e6cb84e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:51.926932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cd9d7-1d88-4bcd-836d-102c1e6cb84e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:51.929125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 632/1274] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:29:51.935408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da22f-b632-4c1c-a3b1-66eaa3c6b495 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:51.935867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da22f-b632-4c1c-a3b1-66eaa3c6b495 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:51.935975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da22f-b632-4c1c-a3b1-66eaa3c6b495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:51.955383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2d1da22f-b632-4c1c-a3b1-66eaa3c6b495 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:51.956622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2d1da22f-b632-4c1c-a3b1-66eaa3c6b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:52.030310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 643/1275] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:29:52.300260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cd9d7-1d88-4bcd-836d-102c1e6cb84e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:52.427170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cd9d7-1d88-4bcd-836d-102c1e6cb84e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:52.444990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:52.464569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:52.465185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:52.465458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:52.465725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:52.476695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:29:52.481470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:52.482507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:29:52.483624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:52.487737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 633/1276] 10.222.0.88 () {56 vars in 1096 bytes} [Wed Aug 24 16:29:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:52.488963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1da22f-b632-4c1c-a3b1-66eaa3c6b495 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:52.579768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:52.599007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1da22f-b632-4c1c-a3b1-66eaa3c6b495 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:52.635622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:52.636230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:52.636509 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:52.636781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:52.637441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:52.637747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:52.639133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:52.647285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 644/1277] 10.222.0.88 () {56 vars in 1099 bytes} [Wed Aug 24 16:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:29:52.654612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:52.764808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2566f6-7a4e-4575-8a79-a39033020091 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:52.800774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:52.801394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:52.801673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:52.801942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:52.812629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:52.814080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:52.828944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:52.830093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:52.831115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:52.831115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:52.831115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:52.831758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 634/1278] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:52.836241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:52.955441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb14a9-94ad-458a-8fed-2e2c67e15131 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:52.999386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:53.000028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:53.000304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:53.000578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:53.001213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:53.001519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:53.002895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:53.015300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 645/1279] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:53.021439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:53.062168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:53.137592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569614-ccf9-434b-b48f-0de2f6054000 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:53.174435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:53.175062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:53.175346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:53.175663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:53.186665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:53.189083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:29:53.203207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:53.204323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:53.205442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 635/1280] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:53.213432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:53.217658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:53.321426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e721-c148-4cc4-949b-b5eb2a202806 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:53.357986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:53.358585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:53.358860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:53.359127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:53.359872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:53.360166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:53.361612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:53.378678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 646/1281] 10.222.0.88 () {56 vars in 1143 bytes} [Wed Aug 24 16:29:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:53.385224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:53.483600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:53.493933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5f727-acc7-41a5-907c-6cbeb249cf09 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:53.529251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:53.529846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:53.530121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:53.530385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:53.612858 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:53.614318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:53.715539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:53.729724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 636/1282] 10.222.0.88 () {58 vars in 1282 bytes} [Wed Aug 24 16:29:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:29:53.736185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:53.799483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:53.840505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301d3b1-79a7-4fdf-af64-e14eefd5b010 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:53.877320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:53.877940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:53.878211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:53.878475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:53.891264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:53.892774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:29:53.908540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:53.909692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:29:53.910787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:29:53.910787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:29:53.910787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:53.911942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 647/1283] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:53.915945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:54.030273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbd9e0-a8cd-4fef-873b-d4b8eff3b235 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:54.065913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:54.066529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:54.066807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:54.067077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:54.067747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:54.068051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:54.069416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:54.081717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 637/1284] 10.222.0.88 () {56 vars in 1109 bytes} [Wed Aug 24 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:54.090603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:54.213475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1142e3-ad4f-4492-926f-584e567fd2e0 None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:54.227209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:54.255659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:54.256308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:54.256582 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:54.256848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:54.263704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:54.265164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:29:54.276308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:54.277404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: ERROR keystone.server.flask.application Aug 24 16:29:54.278448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 648/1285] 10.222.0.88 () {56 vars in 1111 bytes} [Wed Aug 24 16:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:54.283735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:54.337238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:54.389162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529653-b5cf-47ac-8dee-08b03cdbe10b None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:54.425416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4e36c-0f75-443d-9627-78eede39eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:54.426020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e36c-0f75-443d-9627-78eede39eb12 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:54.426301 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e36c-0f75-443d-9627-78eede39eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:54.426572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4e36c-0f75-443d-9627-78eede39eb12 None admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:54.427260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4e36c-0f75-443d-9627-78eede39eb12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:54.427532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4e36c-0f75-443d-9627-78eede39eb12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:54.429024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4e36c-0f75-443d-9627-78eede39eb12 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:54.440807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 638/1286] 10.222.0.88 () {56 vars in 1148 bytes} [Wed Aug 24 16:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:54.449939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:54.564488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcb0a6-f05d-4f24-8ebf-6fa3e17989db None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:54.599386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9ff0-a2ab-4e20-898c-3413bd8bad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:54.600008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9ff0-a2ab-4e20-898c-3413bd8bad40 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:54.600286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9ff0-a2ab-4e20-898c-3413bd8bad40 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:54.600559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9ff0-a2ab-4e20-898c-3413bd8bad40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:54.601281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e9ff0-a2ab-4e20-898c-3413bd8bad40 None admin] RBAC: Adding query filter params (role.id=a4580697b0c74e74a3503324e7660ef5, scope.project.id=f928809858b64247862a3901925f8a43, user.id=d8fe69ee335b461fbfa55620f104beb3) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:54.601588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e9ff0-a2ab-4e20-898c-3413bd8bad40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:54.603089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e9ff0-a2ab-4e20-898c-3413bd8bad40 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:54.609542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 649/1287] 10.222.0.88 () {56 vars in 1374 bytes} [Wed Aug 24 16:29:54 2022] GET /identity/v3/role_assignments?user.id=d8fe69ee335b461fbfa55620f104beb3&scope.project.id=f928809858b64247862a3901925f8a43&role.id=a4580697b0c74e74a3503324e7660ef5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:56.536626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df68a-7828-4da1-90ec-916f178ea81f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:56.537526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df68a-7828-4da1-90ec-916f178ea81f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:56.537526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df68a-7828-4da1-90ec-916f178ea81f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:56.539666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 639/1288] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:29:56.549118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17a4fd-5a6e-4f56-baed-1c953d1bcc79 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:56.549897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17a4fd-5a6e-4f56-baed-1c953d1bcc79 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:56.550077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17a4fd-5a6e-4f56-baed-1c953d1bcc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:56.570781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8c17a4fd-5a6e-4f56-baed-1c953d1bcc79 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:56.572000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8c17a4fd-5a6e-4f56-baed-1c953d1bcc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:56.603476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:56.644945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 650/1289] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:56.913810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744df68a-7828-4da1-90ec-916f178ea81f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:57.040303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744df68a-7828-4da1-90ec-916f178ea81f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:57.050932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:57.076756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:57.077374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:57.077652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:57.077922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:57.078496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:57.079899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:29:57.089170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:29:57.090344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:29:57.091568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 640/1290] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:29:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:29:57.096472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17a4fd-5a6e-4f56-baed-1c953d1bcc79 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:57.214782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17a4fd-5a6e-4f56-baed-1c953d1bcc79 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:57.251289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0fcc2-41df-4d84-a59e-57d8008962bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:57.251917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0fcc2-41df-4d84-a59e-57d8008962bc None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:57.252194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0fcc2-41df-4d84-a59e-57d8008962bc None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:57.252466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0fcc2-41df-4d84-a59e-57d8008962bc None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:57.253091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0fcc2-41df-4d84-a59e-57d8008962bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:57.253390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0fcc2-41df-4d84-a59e-57d8008962bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:57.254761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0fcc2-41df-4d84-a59e-57d8008962bc None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:57.260019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 651/1291] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 16:29:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:57.266506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:57.380015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441fc86-e80b-4e03-a78a-7e7d3ec4b8b6 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:57.417830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd43df-facb-4249-86d3-f8dcb5fc4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:57.418431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd43df-facb-4249-86d3-f8dcb5fc4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:57.418711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd43df-facb-4249-86d3-f8dcb5fc4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:57.418981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd43df-facb-4249-86d3-f8dcb5fc4fa2 None admin] PATH_INFO: `/v3/services` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:57.419627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd43df-facb-4249-86d3-f8dcb5fc4fa2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:29:57.419941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd43df-facb-4249-86d3-f8dcb5fc4fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:57.421331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd43df-facb-4249-86d3-f8dcb5fc4fa2 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:57.426613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 641/1292] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 16:29:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:29:59.319383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2310-82a7-4f69-84e7-fb87104bbd60 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:59.319874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2310-82a7-4f69-84e7-fb87104bbd60 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:59.319982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2310-82a7-4f69-84e7-fb87104bbd60 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:59.321311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 652/1293] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:29:59.326897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735f1b-1cdc-479e-bcb1-0a672127dd29 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:59.327356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735f1b-1cdc-479e-bcb1-0a672127dd29 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:59.327457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735f1b-1cdc-479e-bcb1-0a672127dd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:59.348539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5e735f1b-1cdc-479e-bcb1-0a672127dd29 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:29:59.349736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5e735f1b-1cdc-479e-bcb1-0a672127dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:29:59.382464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:59.434012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 642/1294] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:29:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:29:59.709226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2310-82a7-4f69-84e7-fb87104bbd60 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:29:59.752108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:29:59.837138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2310-82a7-4f69-84e7-fb87104bbd60 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:29:59.872876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1baffc-58ab-4370-af16-dd515f753d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:29:59.873480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1baffc-58ab-4370-af16-dd515f753d48 None admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:29:59.873757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1baffc-58ab-4370-af16-dd515f753d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:29:59.874026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1baffc-58ab-4370-af16-dd515f753d48 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:29:59.874661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1baffc-58ab-4370-af16-dd515f753d48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:29:59.876086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1baffc-58ab-4370-af16-dd515f753d48 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:29:59.893792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 653/1295] 10.222.0.88 () {60 vars in 1141 bytes} [Wed Aug 24 16:29:59 2022] POST /identity/v3/services => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:30:01.804393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b16a-00d3-41a8-bfaf-222ecd5c236b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:01.805230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b16a-00d3-41a8-bfaf-222ecd5c236b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:01.805346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b16a-00d3-41a8-bfaf-222ecd5c236b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:01.807307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 643/1296] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:30:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:30:01.812895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601a42-7fcc-445d-872f-f236e49f50d7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:01.813326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601a42-7fcc-445d-872f-f236e49f50d7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:01.813416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf601a42-7fcc-445d-872f-f236e49f50d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:01.832198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cf601a42-7fcc-445d-872f-f236e49f50d7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:30:01.833381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cf601a42-7fcc-445d-872f-f236e49f50d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:30:01.908852 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 654/1297] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:30:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:30:02.174021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b16a-00d3-41a8-bfaf-222ecd5c236b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:30:02.287877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b16a-00d3-41a8-bfaf-222ecd5c236b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:30:02.326015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:30:02.327081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:02.327081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:02.327283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:02.327761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:30:02.329174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:30:02.349173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:30:02.350401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:30:02.351533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 644/1298] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:30:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:30:02.358364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf601a42-7fcc-445d-872f-f236e49f50d7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:30:02.379189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:02.465124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf601a42-7fcc-445d-872f-f236e49f50d7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:30:02.501396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:30:02.502002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:02.502279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:02.502559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:02.503187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:30:02.503489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:30:02.504900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:30:02.511187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 655/1299] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 16:30:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:30:02.518269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:30:02.558912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:02.638495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281d717-dc4c-4fb7-8bb4-d203b1cd7a67 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:30:02.675672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b342a-c0a0-4d23-8e58-eb8d8c6d8457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:30:02.676280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b342a-c0a0-4d23-8e58-eb8d8c6d8457 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:02.676558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b342a-c0a0-4d23-8e58-eb8d8c6d8457 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:02.676836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b342a-c0a0-4d23-8e58-eb8d8c6d8457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:02.677535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b342a-c0a0-4d23-8e58-eb8d8c6d8457 None admin] RBAC: Adding query filter params (interface=public, service_id=5062e11e3366482bb15b2f149a43da36, region_id=RegionOne) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:30:02.677846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b342a-c0a0-4d23-8e58-eb8d8c6d8457 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:30:02.679221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b342a-c0a0-4d23-8e58-eb8d8c6d8457 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:30:02.685411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 645/1300] 10.222.0.88 () {56 vars in 1251 bytes} [Wed Aug 24 16:30:02 2022] GET /identity/v3/endpoints?service_id=5062e11e3366482bb15b2f149a43da36&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:30:02.694047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:30:02.789357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:02.809416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79203e18-57b2-467c-bfb2-feb13a296e7c None admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:30:02.845303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7b8b0-6bc1-4c5d-9d19-d44ff878a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:30:02.845906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b8b0-6bc1-4c5d-9d19-d44ff878a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:02.846182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b8b0-6bc1-4c5d-9d19-d44ff878a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:02.846455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b8b0-6bc1-4c5d-9d19-d44ff878a1c1 None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:02.847046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7b8b0-6bc1-4c5d-9d19-d44ff878a1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:30:02.848461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7b8b0-6bc1-4c5d-9d19-d44ff878a1c1 None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:30:02.855464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 656/1301] 10.222.0.88 () {56 vars in 1087 bytes} [Wed Aug 24 16:30:02 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:30:04.756212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2357c-2b92-475b-9077-4320ed1687d9 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:04.757025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2357c-2b92-475b-9077-4320ed1687d9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:04.757025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2357c-2b92-475b-9077-4320ed1687d9 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:04.759117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 646/1302] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:30:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:30:04.765537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd55e3-7fa0-4e9d-8303-27993b44a912 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:04.766346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd55e3-7fa0-4e9d-8303-27993b44a912 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:04.766477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd55e3-7fa0-4e9d-8303-27993b44a912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:04.788673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-77cd55e3-7fa0-4e9d-8303-27993b44a912 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:30:04.789843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-77cd55e3-7fa0-4e9d-8303-27993b44a912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:30:04.860857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 657/1303] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:30:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:30:05.126059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2357c-2b92-475b-9077-4320ed1687d9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:30:05.255303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:05.265257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2357c-2b92-475b-9077-4320ed1687d9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:30:05.305159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:30:05.306262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:05.306695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:05.306973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:05.307560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:30:05.308956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:30:05.322292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:30:05.323444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application with Lock( Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: ERROR keystone.server.flask.application Aug 24 16:30:05.325785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 647/1304] 10.222.0.88 () {56 vars in 1117 bytes} [Wed Aug 24 16:30:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:30:05.329913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd55e3-7fa0-4e9d-8303-27993b44a912 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:30:05.410757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:05.434685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd55e3-7fa0-4e9d-8303-27993b44a912 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:30:05.469614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052d3c9-604a-46c7-b2ad-9ad45d8e439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:30:05.470219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052d3c9-604a-46c7-b2ad-9ad45d8e439b None admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:05.470497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052d3c9-604a-46c7-b2ad-9ad45d8e439b None admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:05.470748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052d3c9-604a-46c7-b2ad-9ad45d8e439b None admin] PATH_INFO: `/v3/services` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:05.471393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052d3c9-604a-46c7-b2ad-9ad45d8e439b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:30:05.471724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052d3c9-604a-46c7-b2ad-9ad45d8e439b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:30:05.473111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052d3c9-604a-46c7-b2ad-9ad45d8e439b None admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:30:05.479024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 658/1305] 10.222.0.88 () {56 vars in 1116 bytes} [Wed Aug 24 16:30:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:30:05.485704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:30:05.597554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360dd6c-5f32-4099-8acc-eeb5e646b591 None admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:30:05.634165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e236be-4bc6-418d-97bf-9153704ed4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:30:05.634866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e236be-4bc6-418d-97bf-9153704ed4f6 None admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:30:05.635187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e236be-4bc6-418d-97bf-9153704ed4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:30:05.635505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e236be-4bc6-418d-97bf-9153704ed4f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:30:05.636204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e236be-4bc6-418d-97bf-9153704ed4f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:30:05.637580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e236be-4bc6-418d-97bf-9153704ed4f6 None admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:30:05.666049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 648/1306] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:30:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:30:15.475807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=30 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:30:15.658242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:11.001786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98010b-15a0-4a71-ab05-2e886a279e33 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:11.006932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98010b-15a0-4a71-ab05-2e886a279e33 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:11.007442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98010b-15a0-4a71-ab05-2e886a279e33 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:11.013722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 659/1307] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:11.015439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9a1d-95ff-450e-be74-c9d95500e6d2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:11.015940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9a1d-95ff-450e-be74-c9d95500e6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:11.016022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea9a1d-95ff-450e-be74-c9d95500e6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:11.176221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9bea9a1d-95ff-450e-be74-c9d95500e6d2 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:11.181857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9bea9a1d-95ff-450e-be74-c9d95500e6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:11.404585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 649/1308] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:11.701086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d268-9434-44a9-9cc2-51515d39f6e9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:11.701372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d268-9434-44a9-9cc2-51515d39f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:11.701845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2d268-9434-44a9-9cc2-51515d39f6e9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:11.703911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 660/1309] 10.222.0.88 () {54 vars in 965 bytes} [Wed Aug 24 16:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:11.711028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b604e-7b6a-4070-9c38-2a437aa77ca1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:11.711296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b604e-7b6a-4070-9c38-2a437aa77ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:11.711557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b604e-7b6a-4070-9c38-2a437aa77ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:11.811219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b88b604e-7b6a-4070-9c38-2a437aa77ca1 None None] MFA Rules not processed for user `2fdb46b5aa2c477d8abce5a1eb9fb68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:11.812527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b88b604e-7b6a-4070-9c38-2a437aa77ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:11.837169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:11.900148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 650/1310] 10.222.0.88 () {58 vars in 1062 bytes} [Wed Aug 24 16:31:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:11.909427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2d268-9434-44a9-9cc2-51515d39f6e9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:11.911616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1db2d268-9434-44a9-9cc2-51515d39f6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:12.046310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2d268-9434-44a9-9cc2-51515d39f6e9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:12.128805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4b0d5-e8df-4625-95a3-879e15b6c203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:12.129342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4b0d5-e8df-4625-95a3-879e15b6c203 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:12.129784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4b0d5-e8df-4625-95a3-879e15b6c203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:12.130192 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4b0d5-e8df-4625-95a3-879e15b6c203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:12.132293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fbc4b0d5-e8df-4625-95a3-879e15b6c203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:12.193298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:12.266660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4b0d5-e8df-4625-95a3-879e15b6c203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:12.268334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4b0d5-e8df-4625-95a3-879e15b6c203 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:12.290714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 661/1311] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:14.654823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8eb11-2be5-460f-b0ee-6e6d7d13bdf3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:14.655390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8eb11-2be5-460f-b0ee-6e6d7d13bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:14.655390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8eb11-2be5-460f-b0ee-6e6d7d13bdf3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:14.656644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 651/1312] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:14.662287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3b705-2abd-4980-a8b4-f40105a4017b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:14.662702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3b705-2abd-4980-a8b4-f40105a4017b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:14.662883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3b705-2abd-4980-a8b4-f40105a4017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:14.742992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d7e3b705-2abd-4980-a8b4-f40105a4017b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:14.744285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d7e3b705-2abd-4980-a8b4-f40105a4017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:14.861381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 662/1313] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:15.152321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9448c-3efe-43e5-84f0-1886e3ac738a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:15.152618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9448c-3efe-43e5-84f0-1886e3ac738a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:15.152895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9448c-3efe-43e5-84f0-1886e3ac738a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:15.154252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 652/1314] 10.222.0.88 () {54 vars in 965 bytes} [Wed Aug 24 16:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:15.160681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16cad-c042-4ef7-abd8-6d5e0cf64516 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:15.160960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16cad-c042-4ef7-abd8-6d5e0cf64516 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:15.161265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16cad-c042-4ef7-abd8-6d5e0cf64516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:15.173585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:15.240674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-63f16cad-c042-4ef7-abd8-6d5e0cf64516 None None] MFA Rules not processed for user `2fdb46b5aa2c477d8abce5a1eb9fb68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:15.241887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-63f16cad-c042-4ef7-abd8-6d5e0cf64516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:15.325681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 663/1315] 10.222.0.88 () {58 vars in 1062 bytes} [Wed Aug 24 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:15.334825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9448c-3efe-43e5-84f0-1886e3ac738a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:15.336435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d2e9448c-3efe-43e5-84f0-1886e3ac738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:15.448603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9448c-3efe-43e5-84f0-1886e3ac738a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:15.532328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:15.535344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805409fb-d40e-4b42-a860-57aa409c4ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:15.536043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805409fb-d40e-4b42-a860-57aa409c4ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:15.536711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805409fb-d40e-4b42-a860-57aa409c4ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:15.537113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805409fb-d40e-4b42-a860-57aa409c4ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:15.540419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-805409fb-d40e-4b42-a860-57aa409c4ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:15.674512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805409fb-d40e-4b42-a860-57aa409c4ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:15.675987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805409fb-d40e-4b42-a860-57aa409c4ee5 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:15.695522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 653/1316] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:18.186433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af30e-81a5-41ac-a266-df12eb811664 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:18.187290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af30e-81a5-41ac-a266-df12eb811664 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:18.187290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8af30e-81a5-41ac-a266-df12eb811664 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:18.189525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 664/1317] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:18.195941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf498-f58c-4665-8a0a-f3d3d42f025d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:18.196679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf498-f58c-4665-8a0a-f3d3d42f025d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:18.196863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf498-f58c-4665-8a0a-f3d3d42f025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:18.267338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-14cbf498-f58c-4665-8a0a-f3d3d42f025d None None] MFA Rules not processed for user `27b4b0f5a0a64a95ab7d44d3b0daadb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:18.268675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-14cbf498-f58c-4665-8a0a-f3d3d42f025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:18.326001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:18.382487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 654/1318] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:18.669102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8af30e-81a5-41ac-a266-df12eb811664 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:18.670660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1e8af30e-81a5-41ac-a266-df12eb811664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:18.790796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8af30e-81a5-41ac-a266-df12eb811664 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:18.793920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:18.877851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d0885-7565-4162-9e38-fd9536fae43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:18.878504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d0885-7565-4162-9e38-fd9536fae43c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:18.878997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d0885-7565-4162-9e38-fd9536fae43c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:18.879467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d0885-7565-4162-9e38-fd9536fae43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:18.881299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e23d0885-7565-4162-9e38-fd9536fae43c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:19.000874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d0885-7565-4162-9e38-fd9536fae43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:19.002254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d0885-7565-4162-9e38-fd9536fae43c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:19.023140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 665/1319] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:21.480460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4e68-c274-4a9f-8819-969448dd96bc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:21.481236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4e68-c274-4a9f-8819-969448dd96bc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:21.481236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4e68-c274-4a9f-8819-969448dd96bc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:21.483228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 655/1320] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:21.489665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2fa4-cc00-4617-9ea2-1d211ef43b35 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:21.490130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2fa4-cc00-4617-9ea2-1d211ef43b35 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:21.490323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f2fa4-cc00-4617-9ea2-1d211ef43b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:21.536878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:21.563941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-934f2fa4-cc00-4617-9ea2-1d211ef43b35 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:21.565154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-934f2fa4-cc00-4617-9ea2-1d211ef43b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:21.668408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 666/1321] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:21.960450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4e68-c274-4a9f-8819-969448dd96bc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:21.962982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f10e4e68-c274-4a9f-8819-969448dd96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:22.081893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4e68-c274-4a9f-8819-969448dd96bc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:22.164333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afb9df-005c-48b4-868d-ff249299a428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:22.164944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb9df-005c-48b4-868d-ff249299a428 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:22.165224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb9df-005c-48b4-868d-ff249299a428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:22.165499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb9df-005c-48b4-868d-ff249299a428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:22.167124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11afb9df-005c-48b4-868d-ff249299a428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:22.174537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:22.286608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afb9df-005c-48b4-868d-ff249299a428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:22.288009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afb9df-005c-48b4-868d-ff249299a428 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:22.306718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 656/1322] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:24.906644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35944-a891-436a-877a-1d1986a84288 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:24.907233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35944-a891-436a-877a-1d1986a84288 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:24.907233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35944-a891-436a-877a-1d1986a84288 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:24.908592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 667/1323] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:24.914004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b571-3662-4e17-bb3e-ab5d7bd702ba None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:24.914448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b571-3662-4e17-bb3e-ab5d7bd702ba None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:24.914540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b571-3662-4e17-bb3e-ab5d7bd702ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:24.998210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-69c4b571-3662-4e17-bb3e-ab5d7bd702ba None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:24.999421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-69c4b571-3662-4e17-bb3e-ab5d7bd702ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:25.069370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:25.112089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 657/1324] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:25.393068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35944-a891-436a-877a-1d1986a84288 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:25.394622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4ea35944-a891-436a-877a-1d1986a84288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:25.507614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35944-a891-436a-877a-1d1986a84288 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:25.520464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:25.586735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d7cc8-aedd-435c-992a-1aa1c931ca41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:25.587261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d7cc8-aedd-435c-992a-1aa1c931ca41 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:25.587532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d7cc8-aedd-435c-992a-1aa1c931ca41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:25.587833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d7cc8-aedd-435c-992a-1aa1c931ca41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:25.589405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-542d7cc8-aedd-435c-992a-1aa1c931ca41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:25.704280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d7cc8-aedd-435c-992a-1aa1c931ca41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:25.705759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d7cc8-aedd-435c-992a-1aa1c931ca41 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:25.725375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 668/1325] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:27.676641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a8b4-70d0-4181-81f0-8ffa8c991c7c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:27.677186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a8b4-70d0-4181-81f0-8ffa8c991c7c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:27.677186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352a8b4-70d0-4181-81f0-8ffa8c991c7c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:27.678583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 658/1326] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:31:27.684513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042bb0a-122b-47c9-a6c5-b65e291463ec None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:27.684933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042bb0a-122b-47c9-a6c5-b65e291463ec None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:27.685406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042bb0a-122b-47c9-a6c5-b65e291463ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:27.739000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:27.758327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c042bb0a-122b-47c9-a6c5-b65e291463ec None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:27.759558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c042bb0a-122b-47c9-a6c5-b65e291463ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:27.861703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 669/1327] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:28.142492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a8b4-70d0-4181-81f0-8ffa8c991c7c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:28.144213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a352a8b4-70d0-4181-81f0-8ffa8c991c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:28.255516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352a8b4-70d0-4181-81f0-8ffa8c991c7c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:28.331645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7928c5-4bf3-4652-917f-9ee181c27674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:28.332290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7928c5-4bf3-4652-917f-9ee181c27674 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:28.332561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7928c5-4bf3-4652-917f-9ee181c27674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:28.332830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7928c5-4bf3-4652-917f-9ee181c27674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:28.334448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9a7928c5-4bf3-4652-917f-9ee181c27674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:28.360106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:28.459489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7928c5-4bf3-4652-917f-9ee181c27674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:28.460955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7928c5-4bf3-4652-917f-9ee181c27674 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:28.479222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 659/1328] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:30.443522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322947-cbc6-4fdb-abba-7c979f626038 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:30.444141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322947-cbc6-4fdb-abba-7c979f626038 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:30.444141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322947-cbc6-4fdb-abba-7c979f626038 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:30.445443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 670/1329] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:30.451185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c25be-d0ad-47ae-a33f-8d2ac7af8a61 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:30.451713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c25be-d0ad-47ae-a33f-8d2ac7af8a61 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:30.451830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c25be-d0ad-47ae-a33f-8d2ac7af8a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:30.525545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-218c25be-d0ad-47ae-a33f-8d2ac7af8a61 None None] MFA Rules not processed for user `27b4b0f5a0a64a95ab7d44d3b0daadb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:30.526750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-218c25be-d0ad-47ae-a33f-8d2ac7af8a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:30.602176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:30.638329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 660/1330] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:30.918604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322947-cbc6-4fdb-abba-7c979f626038 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:30.920204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a2322947-cbc6-4fdb-abba-7c979f626038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:31.054962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322947-cbc6-4fdb-abba-7c979f626038 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:31.077942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:31.136937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd9065-afea-4653-8b3f-f3138f8c3f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:31.137560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd9065-afea-4653-8b3f-f3138f8c3f6a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:31.137836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd9065-afea-4653-8b3f-f3138f8c3f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:31.138105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd9065-afea-4653-8b3f-f3138f8c3f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:31.139846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-55cd9065-afea-4653-8b3f-f3138f8c3f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:31.263351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd9065-afea-4653-8b3f-f3138f8c3f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:31.264920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd9065-afea-4653-8b3f-f3138f8c3f6a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:31.284299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 671/1331] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:33.462635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495275-ed10-4509-b5a3-77344141516f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:33.463235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495275-ed10-4509-b5a3-77344141516f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:33.463235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba495275-ed10-4509-b5a3-77344141516f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:33.465831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 661/1332] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:33.471306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ca56-3be7-4fb8-b154-e803c50d2c13 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:33.471885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ca56-3be7-4fb8-b154-e803c50d2c13 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:33.471885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170ca56-3be7-4fb8-b154-e803c50d2c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:33.538084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:33.541281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a170ca56-3be7-4fb8-b154-e803c50d2c13 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:33.543728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a170ca56-3be7-4fb8-b154-e803c50d2c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:33.658438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 672/1333] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:33.942248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495275-ed10-4509-b5a3-77344141516f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:33.944814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ba495275-ed10-4509-b5a3-77344141516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:34.069146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba495275-ed10-4509-b5a3-77344141516f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:34.155040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77219c76-cf4f-43fd-8fb4-02c55845bdfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:34.155684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219c76-cf4f-43fd-8fb4-02c55845bdfb service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:34.155960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219c76-cf4f-43fd-8fb4-02c55845bdfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:34.156225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77219c76-cf4f-43fd-8fb4-02c55845bdfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:34.157882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-77219c76-cf4f-43fd-8fb4-02c55845bdfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:34.187151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:34.283837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219c76-cf4f-43fd-8fb4-02c55845bdfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:34.285282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77219c76-cf4f-43fd-8fb4-02c55845bdfb service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:34.305291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 662/1334] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:36.288116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d4b8-e1fc-48ab-ae96-ddff32a4ad1f None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:36.289056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d4b8-e1fc-48ab-ae96-ddff32a4ad1f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:36.289056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d4b8-e1fc-48ab-ae96-ddff32a4ad1f None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:36.291191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 673/1335] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:36.298328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72523-98c4-4108-bb34-b6deb9bba863 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:36.298766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72523-98c4-4108-bb34-b6deb9bba863 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:36.298864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72523-98c4-4108-bb34-b6deb9bba863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:36.374294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-92b72523-98c4-4108-bb34-b6deb9bba863 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:36.375537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92b72523-98c4-4108-bb34-b6deb9bba863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:36.460061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:36.483060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 663/1336] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:36.777936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d4b8-e1fc-48ab-ae96-ddff32a4ad1f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:36.780814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-61a2d4b8-e1fc-48ab-ae96-ddff32a4ad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:36.897082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d4b8-e1fc-48ab-ae96-ddff32a4ad1f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:36.925738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:36.976483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72715d-7304-4e1e-a363-c6f2e8299add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:36.977093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72715d-7304-4e1e-a363-c6f2e8299add service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:36.977340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72715d-7304-4e1e-a363-c6f2e8299add service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:36.977603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72715d-7304-4e1e-a363-c6f2e8299add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:36.979195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7c72715d-7304-4e1e-a363-c6f2e8299add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:37.096389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72715d-7304-4e1e-a363-c6f2e8299add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:37.097831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72715d-7304-4e1e-a363-c6f2e8299add service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:37.116802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 674/1337] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:39.669576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fca13-9ad4-480d-aa58-a7cdd591320f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:39.670226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fca13-9ad4-480d-aa58-a7cdd591320f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:39.670226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fca13-9ad4-480d-aa58-a7cdd591320f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:39.671474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 664/1338] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:31:39.677014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835966-e2a1-4fee-b6a6-1bc01a6852b1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:39.677429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835966-e2a1-4fee-b6a6-1bc01a6852b1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:39.677544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835966-e2a1-4fee-b6a6-1bc01a6852b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:39.748655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b1835966-e2a1-4fee-b6a6-1bc01a6852b1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:39.749860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b1835966-e2a1-4fee-b6a6-1bc01a6852b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:39.758695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:39.876013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 675/1339] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:40.164229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fca13-9ad4-480d-aa58-a7cdd591320f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:40.165796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-056fca13-9ad4-480d-aa58-a7cdd591320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:40.280232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fca13-9ad4-480d-aa58-a7cdd591320f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:40.371924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25b90f-5425-4161-b31e-aa03483a11ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:40.372551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b90f-5425-4161-b31e-aa03483a11ac service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:40.372825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b90f-5425-4161-b31e-aa03483a11ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:40.373104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25b90f-5425-4161-b31e-aa03483a11ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:40.374715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2c25b90f-5425-4161-b31e-aa03483a11ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:40.412815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:40.493379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25b90f-5425-4161-b31e-aa03483a11ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:40.494807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25b90f-5425-4161-b31e-aa03483a11ac service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:40.515028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 665/1340] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:44.371402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0206-2f99-467e-b05c-9e10b0380821 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:44.372111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0206-2f99-467e-b05c-9e10b0380821 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:44.372111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0206-2f99-467e-b05c-9e10b0380821 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:44.373503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 676/1341] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:44.379753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8d171-0015-46f4-ae1c-6158816d029c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:44.380198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8d171-0015-46f4-ae1c-6158816d029c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:44.380436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8d171-0015-46f4-ae1c-6158816d029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:44.451428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f5d8d171-0015-46f4-ae1c-6158816d029c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:44.452759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f5d8d171-0015-46f4-ae1c-6158816d029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:44.541754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:44.554932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 666/1342] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:44.841884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0206-2f99-467e-b05c-9e10b0380821 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:44.843521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ff0f0206-2f99-467e-b05c-9e10b0380821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:44.952473 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0206-2f99-467e-b05c-9e10b0380821 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:44.993332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:45.032496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3bd16-9631-45a0-b135-8f402d9df1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:45.033241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3bd16-9631-45a0-b135-8f402d9df1da service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:45.033516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3bd16-9631-45a0-b135-8f402d9df1da service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:45.033781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3bd16-9631-45a0-b135-8f402d9df1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:45.035398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d1a3bd16-9631-45a0-b135-8f402d9df1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:45.147135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3bd16-9631-45a0-b135-8f402d9df1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:45.148620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3bd16-9631-45a0-b135-8f402d9df1da service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:45.167100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 677/1343] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:47.876156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c184-9c0b-4308-b6b8-a3e7ddc32369 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:47.876751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c184-9c0b-4308-b6b8-a3e7ddc32369 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:47.876751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c184-9c0b-4308-b6b8-a3e7ddc32369 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:47.878044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 667/1344] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:47.883838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2beddb-b731-4930-9681-4999f5e6959f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:47.884289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2beddb-b731-4930-9681-4999f5e6959f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:47.884399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2beddb-b731-4930-9681-4999f5e6959f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:47.954187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5f2beddb-b731-4930-9681-4999f5e6959f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:47.955384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5f2beddb-b731-4930-9681-4999f5e6959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:47.973997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:48.054339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 678/1345] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:31:48.330858 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c184-9c0b-4308-b6b8-a3e7ddc32369 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:48.332462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b5c9c184-9c0b-4308-b6b8-a3e7ddc32369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:48.447868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c184-9c0b-4308-b6b8-a3e7ddc32369 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:48.525763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cb470-6069-4c84-b77a-db3109410bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:48.526390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb470-6069-4c84-b77a-db3109410bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:48.526671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb470-6069-4c84-b77a-db3109410bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:48.526946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb470-6069-4c84-b77a-db3109410bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:48.528702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-939cb470-6069-4c84-b77a-db3109410bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:48.576541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:48.652361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cb470-6069-4c84-b77a-db3109410bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:48.653770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cb470-6069-4c84-b77a-db3109410bf7 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:48.674106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 668/1346] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:52.641473 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f127b-1e11-4b6d-8dd4-4c2e35bd1e9e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:52.642056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f127b-1e11-4b6d-8dd4-4c2e35bd1e9e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:52.642056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f127b-1e11-4b6d-8dd4-4c2e35bd1e9e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:52.643452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 679/1347] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:52.649022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654661b5-265c-4528-8b4f-1aa61a52a2d2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:52.649458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654661b5-265c-4528-8b4f-1aa61a52a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:52.649667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654661b5-265c-4528-8b4f-1aa61a52a2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:52.727021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-654661b5-265c-4528-8b4f-1aa61a52a2d2 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:52.728314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-654661b5-265c-4528-8b4f-1aa61a52a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:52.830463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:52.837820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 669/1348] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:31:53.114918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f127b-1e11-4b6d-8dd4-4c2e35bd1e9e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:31:53.117344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f54f127b-1e11-4b6d-8dd4-4c2e35bd1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:53.243510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f127b-1e11-4b6d-8dd4-4c2e35bd1e9e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:31:53.298169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:53.329135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55860f41-26a6-4fa0-afb3-1e672936a6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:31:53.330041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860f41-26a6-4fa0-afb3-1e672936a6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:53.330574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860f41-26a6-4fa0-afb3-1e672936a6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:53.331022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860f41-26a6-4fa0-afb3-1e672936a6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:53.333309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-55860f41-26a6-4fa0-afb3-1e672936a6c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:53.450256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55860f41-26a6-4fa0-afb3-1e672936a6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:31:53.451441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55860f41-26a6-4fa0-afb3-1e672936a6c9 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:31:53.469707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 680/1349] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:31:58.392232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd1ca-39ec-4c04-a807-c46fc99d3e39 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:58.392693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd1ca-39ec-4c04-a807-c46fc99d3e39 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:58.392781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd1ca-39ec-4c04-a807-c46fc99d3e39 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:58.394806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 670/1350] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:31:58.400242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae832a-c74a-4b1b-9f0e-ebefc7d99ccf None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:31:58.400684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae832a-c74a-4b1b-9f0e-ebefc7d99ccf None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:31:58.400767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae832a-c74a-4b1b-9f0e-ebefc7d99ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:31:58.497837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-49ae832a-c74a-4b1b-9f0e-ebefc7d99ccf None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:31:58.500117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-49ae832a-c74a-4b1b-9f0e-ebefc7d99ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:31:58.522899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:31:58.645214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 681/1351] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:31:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:02.797198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac722008-b31d-40c2-8d37-5121c1b5b327 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:02.797771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac722008-b31d-40c2-8d37-5121c1b5b327 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:02.797771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac722008-b31d-40c2-8d37-5121c1b5b327 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:02.799299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 671/1352] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:02.804155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90c20f-8526-4855-ab99-a5bc43eb4dd7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:02.804606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90c20f-8526-4855-ab99-a5bc43eb4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:02.805018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90c20f-8526-4855-ab99-a5bc43eb4dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:02.889820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ec90c20f-8526-4855-ab99-a5bc43eb4dd7 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:02.891537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ec90c20f-8526-4855-ab99-a5bc43eb4dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:02.975115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:03.019226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 682/1353] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:32:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:04.553573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ebd58-bbce-4ddd-834c-1a8d247e41b2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:04.554109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ebd58-bbce-4ddd-834c-1a8d247e41b2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:04.554380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ebd58-bbce-4ddd-834c-1a8d247e41b2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:04.555942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 672/1354] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:04.560912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6185f-bb00-48b6-aced-d326b5be8243 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:04.561346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6185f-bb00-48b6-aced-d326b5be8243 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:04.561462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6185f-bb00-48b6-aced-d326b5be8243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:04.641616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a6a6185f-bb00-48b6-aced-d326b5be8243 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:04.642829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a6a6185f-bb00-48b6-aced-d326b5be8243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:04.754536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 683/1355] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:08.219408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b2af-b737-48fc-8e27-2bd29a5004f3 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:08.220011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b2af-b737-48fc-8e27-2bd29a5004f3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:08.220011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b2af-b737-48fc-8e27-2bd29a5004f3 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:08.221520 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 673/1356] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:08.226761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06790d-c1ca-4c4e-9b74-5676897f3ee1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:08.227174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06790d-c1ca-4c4e-9b74-5676897f3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:08.227305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06790d-c1ca-4c4e-9b74-5676897f3ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:08.268348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:08.311468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ec06790d-c1ca-4c4e-9b74-5676897f3ee1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:08.312226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ec06790d-c1ca-4c4e-9b74-5676897f3ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:08.459238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 684/1357] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:08.770907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a275d5-a2ab-4098-b272-696f730c4e00 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:08.771781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a275d5-a2ab-4098-b272-696f730c4e00 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:08.772349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a275d5-a2ab-4098-b272-696f730c4e00 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:08.773956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 674/1358] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 16:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:08.781534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e9b0e-1f57-412a-816f-1dd356540097 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:08.782094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e9b0e-1f57-412a-816f-1dd356540097 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:08.783919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e9b0e-1f57-412a-816f-1dd356540097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:08.879955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-859e9b0e-1f57-412a-816f-1dd356540097 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:08.881344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-859e9b0e-1f57-412a-816f-1dd356540097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:08.939992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:09.031385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 685/1359] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:09.039172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a275d5-a2ab-4098-b272-696f730c4e00 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:09.040865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-10a275d5-a2ab-4098-b272-696f730c4e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:09.202145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a275d5-a2ab-4098-b272-696f730c4e00 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:09.280267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:09.323894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b80a76-df30-40d3-896f-cc6137ac8076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:09.324643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80a76-df30-40d3-896f-cc6137ac8076 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:09.325015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80a76-df30-40d3-896f-cc6137ac8076 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:09.325402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80a76-df30-40d3-896f-cc6137ac8076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:09.327201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a5b80a76-df30-40d3-896f-cc6137ac8076 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:09.428363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b80a76-df30-40d3-896f-cc6137ac8076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:09.429978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b80a76-df30-40d3-896f-cc6137ac8076 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:09.449121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 675/1360] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:11.570214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7661-d4d1-40b6-a0d8-bf6e4d33e7b1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:11.570759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7661-d4d1-40b6-a0d8-bf6e4d33e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:11.570759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7661-d4d1-40b6-a0d8-bf6e4d33e7b1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:11.572363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 686/1361] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:11.577642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3112211-4230-49fb-9f51-841080dc5a8b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:11.578066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3112211-4230-49fb-9f51-841080dc5a8b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:11.578145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3112211-4230-49fb-9f51-841080dc5a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:11.649692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c3112211-4230-49fb-9f51-841080dc5a8b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:11.650894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c3112211-4230-49fb-9f51-841080dc5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:11.693790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:11.760395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 676/1362] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:12.052774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7661-d4d1-40b6-a0d8-bf6e4d33e7b1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:12.054383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-35ac7661-d4d1-40b6-a0d8-bf6e4d33e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:12.215805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7661-d4d1-40b6-a0d8-bf6e4d33e7b1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:12.226021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:12.347003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836a2dc-0efe-42a2-b661-68dc104d54af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:12.347668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836a2dc-0efe-42a2-b661-68dc104d54af service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:12.347940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836a2dc-0efe-42a2-b661-68dc104d54af service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:12.348223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836a2dc-0efe-42a2-b661-68dc104d54af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:12.349843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e836a2dc-0efe-42a2-b661-68dc104d54af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:12.449474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836a2dc-0efe-42a2-b661-68dc104d54af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:12.451481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836a2dc-0efe-42a2-b661-68dc104d54af service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:12.472120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 687/1363] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:14.697856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedb6ae-e90f-4ea8-a7f4-94629728b300 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:14.697856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedb6ae-e90f-4ea8-a7f4-94629728b300 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:14.698448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedb6ae-e90f-4ea8-a7f4-94629728b300 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:14.699367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 677/1364] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:14.706033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81214-083f-4b5c-aecd-db5de871fc96 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:14.708060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81214-083f-4b5c-aecd-db5de871fc96 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:14.708668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f81214-083f-4b5c-aecd-db5de871fc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:14.732653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:14.792616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d6f81214-083f-4b5c-aecd-db5de871fc96 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:14.793862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d6f81214-083f-4b5c-aecd-db5de871fc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:14.902010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 688/1365] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:15.229053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6987d5-a513-44a6-a824-28a5635456ea None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:15.229583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6987d5-a513-44a6-a824-28a5635456ea None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:15.230123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6987d5-a513-44a6-a824-28a5635456ea None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:15.233345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 678/1366] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 16:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:15.242129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096727b-72ec-417b-8268-94362647db43 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:15.242422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096727b-72ec-417b-8268-94362647db43 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:15.242757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096727b-72ec-417b-8268-94362647db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:15.351234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8096727b-72ec-417b-8268-94362647db43 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:15.352500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8096727b-72ec-417b-8268-94362647db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:15.391210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:15.493493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 689/1367] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:15.501977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6987d5-a513-44a6-a824-28a5635456ea None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:15.503646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2b6987d5-a513-44a6-a824-28a5635456ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:15.698318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6987d5-a513-44a6-a824-28a5635456ea None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:15.726122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:15.844817 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943ea5d-1faa-43b4-90df-28772f04d14c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:15.845957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943ea5d-1faa-43b4-90df-28772f04d14c service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:15.846554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943ea5d-1faa-43b4-90df-28772f04d14c service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:15.846980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943ea5d-1faa-43b4-90df-28772f04d14c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:15.848884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6943ea5d-1faa-43b4-90df-28772f04d14c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:15.950725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943ea5d-1faa-43b4-90df-28772f04d14c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:15.952754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943ea5d-1faa-43b4-90df-28772f04d14c service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:15.972635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 679/1368] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:16.624285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dff92-caa2-4ba8-aade-a61099c7a4bc None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:16.624820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dff92-caa2-4ba8-aade-a61099c7a4bc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:16.624820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dff92-caa2-4ba8-aade-a61099c7a4bc None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:16.626333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 690/1369] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:16.631886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ba9d-3bc1-4239-b0c2-5bcdf5d45a44 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:16.632176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ba9d-3bc1-4239-b0c2-5bcdf5d45a44 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:16.632790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ba9d-3bc1-4239-b0c2-5bcdf5d45a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:16.672661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:16.721535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f3f3ba9d-3bc1-4239-b0c2-5bcdf5d45a44 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:16.723175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f3f3ba9d-3bc1-4239-b0c2-5bcdf5d45a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:16.847648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 680/1370] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:17.446758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01595d1b-0bde-4fc5-aeb1-f162dee3b3b9 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:17.447114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01595d1b-0bde-4fc5-aeb1-f162dee3b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:17.447460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01595d1b-0bde-4fc5-aeb1-f162dee3b3b9 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:17.449132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 691/1371] 10.222.0.88 () {54 vars in 964 bytes} [Wed Aug 24 16:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:17.454724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471604b-6d89-42e8-8efb-41d0dd126f44 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:17.455193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471604b-6d89-42e8-8efb-41d0dd126f44 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:17.455486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471604b-6d89-42e8-8efb-41d0dd126f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:17.539610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f471604b-6d89-42e8-8efb-41d0dd126f44 None None] MFA Rules not processed for user `e6ef2398772541fa85ea0d46d6faf3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:17.540834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f471604b-6d89-42e8-8efb-41d0dd126f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:17.591773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:17.624946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 681/1372] 10.222.0.88 () {58 vars in 1061 bytes} [Wed Aug 24 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:17.633037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01595d1b-0bde-4fc5-aeb1-f162dee3b3b9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:17.634568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-01595d1b-0bde-4fc5-aeb1-f162dee3b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:17.752749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01595d1b-0bde-4fc5-aeb1-f162dee3b3b9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:17.798602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:17.844514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:17.845069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:17.845350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:17.845612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:17.847420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:17.955040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8ebb8-9df6-43cd-bfbb-c1806c9ad3fe None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:17.955555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8ebb8-9df6-43cd-bfbb-c1806c9ad3fe None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:17.955697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8ebb8-9df6-43cd-bfbb-c1806c9ad3fe None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:17.956965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 682/1373] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:17.965208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f76c92-f9ab-47a2-b02f-873f440c3108 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:17.965542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f76c92-f9ab-47a2-b02f-873f440c3108 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:17.965813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f76c92-f9ab-47a2-b02f-873f440c3108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:17.980321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:17.981996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:18.008163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 692/1374] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:18.056002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-28f76c92-f9ab-47a2-b02f-873f440c3108 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:18.057613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-28f76c92-f9ab-47a2-b02f-873f440c3108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:18.176629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 683/1375] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:18.466587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:18.467861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:18.542040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:18.576334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebefb1-795d-4d20-a257-0ec86d9a6b59 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:18.706105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad216476-13ce-4b3e-b9f8-94d788c2b114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:18.706769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad216476-13ce-4b3e-b9f8-94d788c2b114 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:18.706947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad216476-13ce-4b3e-b9f8-94d788c2b114 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:18.707353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad216476-13ce-4b3e-b9f8-94d788c2b114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:18.709180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ad216476-13ce-4b3e-b9f8-94d788c2b114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:18.793329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:18.805450 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad216476-13ce-4b3e-b9f8-94d788c2b114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:18.807162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad216476-13ce-4b3e-b9f8-94d788c2b114 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:18.827392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 693/1376] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:20.747460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b373-f055-44b5-834f-f575eb0d2532 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:20.748118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b373-f055-44b5-834f-f575eb0d2532 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:20.748118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b373-f055-44b5-834f-f575eb0d2532 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:20.749395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 684/1377] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:20.754904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7802a6-b105-4c87-8dc0-56c0f8838de3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:20.755304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7802a6-b105-4c87-8dc0-56c0f8838de3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:20.755482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7802a6-b105-4c87-8dc0-56c0f8838de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:20.823924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ab7802a6-b105-4c87-8dc0-56c0f8838de3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:20.825135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ab7802a6-b105-4c87-8dc0-56c0f8838de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:20.927526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 694/1378] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:21.234612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0b373-f055-44b5-834f-f575eb0d2532 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:21.236172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-85b0b373-f055-44b5-834f-f575eb0d2532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:21.293821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:21.402093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0b373-f055-44b5-834f-f575eb0d2532 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:21.554026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c1619-ac94-44ce-869e-7e53e5b1846a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:21.554912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1619-ac94-44ce-869e-7e53e5b1846a service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:21.555447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1619-ac94-44ce-869e-7e53e5b1846a service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:21.556056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1619-ac94-44ce-869e-7e53e5b1846a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:21.557884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f57c1619-ac94-44ce-869e-7e53e5b1846a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:21.579209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:21.682213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c1619-ac94-44ce-869e-7e53e5b1846a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:21.684247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c1619-ac94-44ce-869e-7e53e5b1846a service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:21.707560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 685/1379] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:23.652622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa8cba-2097-4ca5-98b5-df07c6a01d62 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:23.654796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa8cba-2097-4ca5-98b5-df07c6a01d62 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:23.655293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa8cba-2097-4ca5-98b5-df07c6a01d62 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:23.657594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 695/1380] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:23.662538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f22e0-bb51-4e46-81fa-7a702c35a038 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:23.663035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f22e0-bb51-4e46-81fa-7a702c35a038 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:23.663035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f22e0-bb51-4e46-81fa-7a702c35a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:23.735251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d56f22e0-bb51-4e46-81fa-7a702c35a038 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:23.736591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d56f22e0-bb51-4e46-81fa-7a702c35a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:23.823904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:23.838164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 686/1381] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:24.122895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa8cba-2097-4ca5-98b5-df07c6a01d62 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:24.124865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d1fa8cba-2097-4ca5-98b5-df07c6a01d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:24.203197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:24.306116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa8cba-2097-4ca5-98b5-df07c6a01d62 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:24.441706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6ada-5ea6-44fd-9a57-88409bdc838f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:24.442219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6ada-5ea6-44fd-9a57-88409bdc838f service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:24.442494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6ada-5ea6-44fd-9a57-88409bdc838f service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:24.442755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6ada-5ea6-44fd-9a57-88409bdc838f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:24.444376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-725c6ada-5ea6-44fd-9a57-88409bdc838f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:24.467210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:24.543827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c6ada-5ea6-44fd-9a57-88409bdc838f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:24.545581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c6ada-5ea6-44fd-9a57-88409bdc838f service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:24.564811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 696/1382] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:26.699452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba5d58-4186-4e6e-a4c7-6c211b63ddaf None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:26.700235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba5d58-4186-4e6e-a4c7-6c211b63ddaf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:26.700235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba5d58-4186-4e6e-a4c7-6c211b63ddaf None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:26.701291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 687/1383] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:26.706852 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df7748-d82f-4152-9f75-648441af4580 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:26.707546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df7748-d82f-4152-9f75-648441af4580 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:26.707699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df7748-d82f-4152-9f75-648441af4580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:26.786639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-88df7748-d82f-4152-9f75-648441af4580 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:26.787914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-88df7748-d82f-4152-9f75-648441af4580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:26.897329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:26.901403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 697/1384] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:27.184092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba5d58-4186-4e6e-a4c7-6c211b63ddaf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:27.186307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f6ba5d58-4186-4e6e-a4c7-6c211b63ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:27.355786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba5d58-4186-4e6e-a4c7-6c211b63ddaf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:27.424842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:27.489441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb176f-a02b-46d9-9fe5-c40e0b8e6148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:27.490239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb176f-a02b-46d9-9fe5-c40e0b8e6148 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:27.490588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb176f-a02b-46d9-9fe5-c40e0b8e6148 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:27.490928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb176f-a02b-46d9-9fe5-c40e0b8e6148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:27.493017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-76fb176f-a02b-46d9-9fe5-c40e0b8e6148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:27.610439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb176f-a02b-46d9-9fe5-c40e0b8e6148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:27.612525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb176f-a02b-46d9-9fe5-c40e0b8e6148 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:27.633278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 688/1385] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:30.013289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bb15b-c116-4f4a-8acd-dee2ac3a277b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:30.014353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bb15b-c116-4f4a-8acd-dee2ac3a277b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:30.014353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bb15b-c116-4f4a-8acd-dee2ac3a277b None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:30.015341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 698/1386] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:30.021816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7d106-3142-4226-b892-52690a76dab3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:30.022661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7d106-3142-4226-b892-52690a76dab3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:30.022661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7d106-3142-4226-b892-52690a76dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:30.109433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-dcc7d106-3142-4226-b892-52690a76dab3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:30.111053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dcc7d106-3142-4226-b892-52690a76dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:30.143877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:30.236542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 689/1387] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:30.523079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bb15b-c116-4f4a-8acd-dee2ac3a277b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:30.524720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-699bb15b-c116-4f4a-8acd-dee2ac3a277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:30.692168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bb15b-c116-4f4a-8acd-dee2ac3a277b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:30.765788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:30.816616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144db46-913a-4061-a39c-b3e5d78e26a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:30.817379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144db46-913a-4061-a39c-b3e5d78e26a8 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:30.817732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144db46-913a-4061-a39c-b3e5d78e26a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:30.818073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144db46-913a-4061-a39c-b3e5d78e26a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:30.820209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c144db46-913a-4061-a39c-b3e5d78e26a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:30.929224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144db46-913a-4061-a39c-b3e5d78e26a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:30.931282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144db46-913a-4061-a39c-b3e5d78e26a8 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:30.956110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 699/1388] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:32.906254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492c30-bc73-4921-ac72-a47666949320 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:32.906857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492c30-bc73-4921-ac72-a47666949320 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:32.906857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492c30-bc73-4921-ac72-a47666949320 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:32.908210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 690/1389] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:32.913803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5f71-97a4-4dec-a1ec-640f495053ce None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:32.914249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5f71-97a4-4dec-a1ec-640f495053ce None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:32.914347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5f71-97a4-4dec-a1ec-640f495053ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:32.988714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-dbba5f71-97a4-4dec-a1ec-640f495053ce None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:32.989933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dbba5f71-97a4-4dec-a1ec-640f495053ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:33.028093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:33.095110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 700/1390] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:33.395831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18492c30-bc73-4921-ac72-a47666949320 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:33.397702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-18492c30-bc73-4921-ac72-a47666949320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:33.441452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93201349-cdc9-430e-b569-555ab9078adf None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:33.441660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93201349-cdc9-430e-b569-555ab9078adf None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:33.441913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93201349-cdc9-430e-b569-555ab9078adf None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:33.443300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 701/1391] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:32:33.449363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643db87-e87c-458a-b3a3-78b937e2e4cb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:33.449807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643db87-e87c-458a-b3a3-78b937e2e4cb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:33.450091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643db87-e87c-458a-b3a3-78b937e2e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:33.531867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1643db87-e87c-458a-b3a3-78b937e2e4cb None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:33.533557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1643db87-e87c-458a-b3a3-78b937e2e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:33.569804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18492c30-bc73-4921-ac72-a47666949320 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:33.582252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:33.647030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 702/1392] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:33.696785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af912e-90ef-4ee0-9f13-c258dea571a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:33.697300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af912e-90ef-4ee0-9f13-c258dea571a0 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:33.697575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af912e-90ef-4ee0-9f13-c258dea571a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:33.697840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af912e-90ef-4ee0-9f13-c258dea571a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:33.699433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-75af912e-90ef-4ee0-9f13-c258dea571a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:33.928659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af912e-90ef-4ee0-9f13-c258dea571a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:33.930480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af912e-90ef-4ee0-9f13-c258dea571a0 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:33.950136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 691/1393] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:33.958316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea64e-2fdc-48ff-902c-58c60cbeea76 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:33.958724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea64e-2fdc-48ff-902c-58c60cbeea76 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:33.958835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea64e-2fdc-48ff-902c-58c60cbeea76 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:33.960224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 703/1394] 10.222.0.88 () {54 vars in 967 bytes} [Wed Aug 24 16:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:33.965755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1742f-7198-428d-88b3-ebeda54b9389 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:33.966076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1742f-7198-428d-88b3-ebeda54b9389 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:33.966349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1742f-7198-428d-88b3-ebeda54b9389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:33.982530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:34.048583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f9e1742f-7198-428d-88b3-ebeda54b9389 None None] MFA Rules not processed for user `f0a331472a0040d68824a2245bf3e716`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:34.049899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f9e1742f-7198-428d-88b3-ebeda54b9389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:34.136221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 692/1395] 10.222.0.88 () {58 vars in 1064 bytes} [Wed Aug 24 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:34.144126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ea64e-2fdc-48ff-902c-58c60cbeea76 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:34.145785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-891ea64e-2fdc-48ff-902c-58c60cbeea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:34.166059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:34.258079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ea64e-2fdc-48ff-902c-58c60cbeea76 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:34.339308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f1ae-eb32-4aaf-8e14-625b959fcb78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a331472a0040d68824a2245bf3e716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:34.339982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f1ae-eb32-4aaf-8e14-625b959fcb78 service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:34.340235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f1ae-eb32-4aaf-8e14-625b959fcb78 service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:34.340505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f1ae-eb32-4aaf-8e14-625b959fcb78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:34.342211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9831f1ae-eb32-4aaf-8e14-625b959fcb78 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:34.421373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:34.464387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f1ae-eb32-4aaf-8e14-625b959fcb78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:34.466053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f1ae-eb32-4aaf-8e14-625b959fcb78 service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:34.485618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 704/1396] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:35.237377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098c473-d764-4ca3-a048-9db4d087e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:35.237905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098c473-d764-4ca3-a048-9db4d087e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:35.238107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098c473-d764-4ca3-a048-9db4d087e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:35.310489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b098c473-d764-4ca3-a048-9db4d087e1a1 None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:35.311940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b098c473-d764-4ca3-a048-9db4d087e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:35.376162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:35.409404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 693/1397] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:35.453148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffdf4d-25c7-47cf-9d69-9216f7ca8c59 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:35.453676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffdf4d-25c7-47cf-9d69-9216f7ca8c59 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:35.453676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffdf4d-25c7-47cf-9d69-9216f7ca8c59 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:35.455057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 705/1398] 10.222.0.88 () {54 vars in 943 bytes} [Wed Aug 24 16:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:35.461731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb00b1-dc98-42a9-b788-c44653f19ead None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:35.462017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb00b1-dc98-42a9-b788-c44653f19ead None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:35.462275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb00b1-dc98-42a9-b788-c44653f19ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:35.543263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4ecb00b1-dc98-42a9-b788-c44653f19ead None None] MFA Rules not processed for user `4ed343e58e9d494aa4b303e5bf95b54e`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:35.544506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4ecb00b1-dc98-42a9-b788-c44653f19ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:35.656013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 694/1399] 10.222.0.88 () {58 vars in 1040 bytes} [Wed Aug 24 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:35.665711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffdf4d-25c7-47cf-9d69-9216f7ca8c59 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:35.667266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bbffdf4d-25c7-47cf-9d69-9216f7ca8c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:35.816524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffdf4d-25c7-47cf-9d69-9216f7ca8c59 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:35.856269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:35.905918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0983b-5c6e-44ee-b29a-a545f8bfe747 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:35.906199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0983b-5c6e-44ee-b29a-a545f8bfe747 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:35.906469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0983b-5c6e-44ee-b29a-a545f8bfe747 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:35.907869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 695/1400] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:32:35.912939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740667bf-5227-46df-92c3-111b257b78f4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:35.913228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740667bf-5227-46df-92c3-111b257b78f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:35.913507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740667bf-5227-46df-92c3-111b257b78f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:35.927481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:35.928133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:35.928406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:35.928671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:35.930322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:35.949639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:35.981981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-740667bf-5227-46df-92c3-111b257b78f4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:35.983241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-740667bf-5227-46df-92c3-111b257b78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:36.015988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:36.017976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:36.025868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 706/1401] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:32:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:32:36.093707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 696/1402] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:32:36.398719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:36.400018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:36.481373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:36.511091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e723b-52c7-4266-90b6-59419c484213 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:36.638917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41081776-0b82-4ab0-8763-69796fd9a63d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:36.640261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081776-0b82-4ab0-8763-69796fd9a63d service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:36.640542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081776-0b82-4ab0-8763-69796fd9a63d service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:36.640810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41081776-0b82-4ab0-8763-69796fd9a63d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:36.642459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-41081776-0b82-4ab0-8763-69796fd9a63d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:36.750357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41081776-0b82-4ab0-8763-69796fd9a63d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:36.752853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41081776-0b82-4ab0-8763-69796fd9a63d service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:36.758528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:36.784664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 707/1403] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:32:38.766993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c6ea-dbd8-4843-9075-2efc1cc77b06 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:38.767564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c6ea-dbd8-4843-9075-2efc1cc77b06 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:38.767564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c6ea-dbd8-4843-9075-2efc1cc77b06 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:38.774461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 697/1404] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:38.777642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e0b66-d5be-4a9b-b676-ce261ee7c2a7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:38.778122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e0b66-d5be-4a9b-b676-ce261ee7c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:38.778222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e0b66-d5be-4a9b-b676-ce261ee7c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:38.862892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-de9e0b66-d5be-4a9b-b676-ce261ee7c2a7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:38.864179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-de9e0b66-d5be-4a9b-b676-ce261ee7c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:39.002198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 708/1405] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:39.293745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92c6ea-dbd8-4843-9075-2efc1cc77b06 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:39.295430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ba92c6ea-dbd8-4843-9075-2efc1cc77b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:39.457322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:39.513284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92c6ea-dbd8-4843-9075-2efc1cc77b06 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:39.669197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113afc5-4d3e-42e0-bb08-d1c618b601a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:39.670346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113afc5-4d3e-42e0-bb08-d1c618b601a7 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:39.670633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113afc5-4d3e-42e0-bb08-d1c618b601a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:39.671352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113afc5-4d3e-42e0-bb08-d1c618b601a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:39.673954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f113afc5-4d3e-42e0-bb08-d1c618b601a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:39.768795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:39.789173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113afc5-4d3e-42e0-bb08-d1c618b601a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:39.791872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113afc5-4d3e-42e0-bb08-d1c618b601a7 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:39.812552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 698/1406] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:41.821311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c95a-ec86-4f33-ae69-1ec18ca4f3c8 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:41.821948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c95a-ec86-4f33-ae69-1ec18ca4f3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:41.821948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c95a-ec86-4f33-ae69-1ec18ca4f3c8 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:41.823506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 709/1407] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:41.831407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25fc18-ac8f-45ad-bace-77c25add9e28 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:41.832057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25fc18-ac8f-45ad-bace-77c25add9e28 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:41.832057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25fc18-ac8f-45ad-bace-77c25add9e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:41.927444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0e25fc18-ac8f-45ad-bace-77c25add9e28 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:41.928737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0e25fc18-ac8f-45ad-bace-77c25add9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:42.068259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 699/1408] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:42.359868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c95a-ec86-4f33-ae69-1ec18ca4f3c8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:32:42.361806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc40c95a-ec86-4f33-ae69-1ec18ca4f3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:42.446316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:42.547858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c95a-ec86-4f33-ae69-1ec18ca4f3c8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:32:42.698091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563e785-2a9b-402c-b83f-6c76df8512f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:32:42.698623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563e785-2a9b-402c-b83f-6c76df8512f1 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:42.698901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563e785-2a9b-402c-b83f-6c76df8512f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:42.699166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563e785-2a9b-402c-b83f-6c76df8512f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:42.700808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9563e785-2a9b-402c-b83f-6c76df8512f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:42.739162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:42.832109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563e785-2a9b-402c-b83f-6c76df8512f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:32:42.834667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563e785-2a9b-402c-b83f-6c76df8512f1 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:32:42.864409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 710/1409] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:32:52.066044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=79 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:52.861098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=33 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:59.223271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f53fb-6f58-4e79-93fa-ce3778033ac7 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:59.223892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f53fb-6f58-4e79-93fa-ce3778033ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:59.223892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f53fb-6f58-4e79-93fa-ce3778033ac7 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:59.225218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 700/1410] 10.222.0.88 () {54 vars in 918 bytes} [Wed Aug 24 16:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:59.230679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b59f-fd82-4bd6-8745-211a876a6a64 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:59.231119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b59f-fd82-4bd6-8745-211a876a6a64 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:59.231220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5b59f-fd82-4bd6-8745-211a876a6a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:59.314533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-70a5b59f-fd82-4bd6-8745-211a876a6a64 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:59.315828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-70a5b59f-fd82-4bd6-8745-211a876a6a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:59.444902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 711/1411] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Aug 24 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:32:59.460281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79cf19-a21e-4368-9452-25ef455f9155 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:59.460564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79cf19-a21e-4368-9452-25ef455f9155 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:59.460835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79cf19-a21e-4368-9452-25ef455f9155 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:59.462176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 701/1412] 10.222.0.88 () {54 vars in 918 bytes} [Wed Aug 24 16:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:32:59.467406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7569-0d9e-461a-bc71-6155debc2ab9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:32:59.468132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7569-0d9e-461a-bc71-6155debc2ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:32:59.468132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7569-0d9e-461a-bc71-6155debc2ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:32:59.545400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:32:59.549211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7c1d7569-0d9e-461a-bc71-6155debc2ab9 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:32:59.551547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7c1d7569-0d9e-461a-bc71-6155debc2ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:32:59.694804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 712/1413] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Aug 24 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:02.113462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005f7f-1b77-4867-96a9-9f14287aaee4 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:02.114072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005f7f-1b77-4867-96a9-9f14287aaee4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:02.114072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005f7f-1b77-4867-96a9-9f14287aaee4 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:02.115971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:02.123996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f105f1-7d1b-45a6-84ef-757a737f1b91 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:02.124751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f105f1-7d1b-45a6-84ef-757a737f1b91 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:02.124751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f105f1-7d1b-45a6-84ef-757a737f1b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:02.203523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-37f105f1-7d1b-45a6-84ef-757a737f1b91 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:02.204933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-37f105f1-7d1b-45a6-84ef-757a737f1b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:02.261868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:02.308355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:02.595980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005f7f-1b77-4867-96a9-9f14287aaee4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:02.597518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-83005f7f-1b77-4867-96a9-9f14287aaee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:02.752718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005f7f-1b77-4867-96a9-9f14287aaee4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:02.836625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:02.879713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b2a7c-5acb-4233-875c-8e7afd3277be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:02.880329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2a7c-5acb-4233-875c-8e7afd3277be service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:02.880606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2a7c-5acb-4233-875c-8e7afd3277be service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:02.880876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b2a7c-5acb-4233-875c-8e7afd3277be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:02.882488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bf9b2a7c-5acb-4233-875c-8e7afd3277be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:02.985717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b2a7c-5acb-4233-875c-8e7afd3277be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:02.987309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b2a7c-5acb-4233-875c-8e7afd3277be service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:03.006230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 703/1416] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:03.922178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71909f7-1a5a-42a2-ad2b-0921b0293730 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:03.923114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71909f7-1a5a-42a2-ad2b-0921b0293730 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:03.923114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71909f7-1a5a-42a2-ad2b-0921b0293730 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:03.925235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:03.931345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0450eb-a7fe-45fe-941b-6394c5ba47a2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:03.932114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0450eb-a7fe-45fe-941b-6394c5ba47a2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:03.932280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0450eb-a7fe-45fe-941b-6394c5ba47a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:04.012700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-db0450eb-a7fe-45fe-941b-6394c5ba47a2 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:04.013944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-db0450eb-a7fe-45fe-941b-6394c5ba47a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:04.042293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:04.130279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:04.283451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71909f7-1a5a-42a2-ad2b-0921b0293730 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:04.285133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e71909f7-1a5a-42a2-ad2b-0921b0293730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:04.439194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71909f7-1a5a-42a2-ad2b-0921b0293730 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:04.483420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:04.560760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395f2e4-bd92-494c-a17e-dc88bb6f01d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:04.561685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395f2e4-bd92-494c-a17e-dc88bb6f01d8 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:04.561966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395f2e4-bd92-494c-a17e-dc88bb6f01d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:04.562233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395f2e4-bd92-494c-a17e-dc88bb6f01d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:04.563904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4395f2e4-bd92-494c-a17e-dc88bb6f01d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:04.656863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395f2e4-bd92-494c-a17e-dc88bb6f01d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:04.658474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395f2e4-bd92-494c-a17e-dc88bb6f01d8 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:04.677260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 715/1419] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:05.563872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0e741-5a3d-4288-86a6-faf4f13aec68 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:05.564688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0e741-5a3d-4288-86a6-faf4f13aec68 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:05.564688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0e741-5a3d-4288-86a6-faf4f13aec68 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:05.567032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:05.573148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d9985-555c-42a7-ab30-e1b041aab542 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:05.573853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d9985-555c-42a7-ab30-e1b041aab542 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:05.573993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d9985-555c-42a7-ab30-e1b041aab542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:05.641550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:05.664838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3e6d9985-555c-42a7-ab30-e1b041aab542 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:05.666085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3e6d9985-555c-42a7-ab30-e1b041aab542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:05.783942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:05.940826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0e741-5a3d-4288-86a6-faf4f13aec68 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:05.942301 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d7c0e741-5a3d-4288-86a6-faf4f13aec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:06.141748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0e741-5a3d-4288-86a6-faf4f13aec68 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:06.154739 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:06.265826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6b81d-40d6-4a25-a5ee-d9289d3dead6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:06.266344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b81d-40d6-4a25-a5ee-d9289d3dead6 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:06.266625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b81d-40d6-4a25-a5ee-d9289d3dead6 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:06.266895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6b81d-40d6-4a25-a5ee-d9289d3dead6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:06.268531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-16c6b81d-40d6-4a25-a5ee-d9289d3dead6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:06.366267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6b81d-40d6-4a25-a5ee-d9289d3dead6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:06.368782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6b81d-40d6-4a25-a5ee-d9289d3dead6 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:06.395654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 706/1422] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:07.271964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97f60c-8f71-4112-8583-24df84f1a9f1 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:07.272572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97f60c-8f71-4112-8583-24df84f1a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:07.272572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97f60c-8f71-4112-8583-24df84f1a9f1 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:07.273862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:07.282498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e25e-b4ba-4d9f-abae-7f1993ac4a06 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:07.283208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e25e-b4ba-4d9f-abae-7f1993ac4a06 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:07.283391 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e25e-b4ba-4d9f-abae-7f1993ac4a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:07.309687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:07.373577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d644e25e-b4ba-4d9f-abae-7f1993ac4a06 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:07.374844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d644e25e-b4ba-4d9f-abae-7f1993ac4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:07.488267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:07.644551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97f60c-8f71-4112-8583-24df84f1a9f1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:07.646890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4b97f60c-8f71-4112-8583-24df84f1a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:07.784414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:07.822978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97f60c-8f71-4112-8583-24df84f1a9f1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:07.944070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d609a-d97e-4914-99e3-198ae4aaba8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:07.944685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d609a-d97e-4914-99e3-198ae4aaba8a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:07.944963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d609a-d97e-4914-99e3-198ae4aaba8a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:07.945260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d609a-d97e-4914-99e3-198ae4aaba8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:07.946845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e87d609a-d97e-4914-99e3-198ae4aaba8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:08.030440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:08.045349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d609a-d97e-4914-99e3-198ae4aaba8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:08.047176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d609a-d97e-4914-99e3-198ae4aaba8a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:08.065687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 718/1425] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:08.944909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68ce43-a79f-4a42-99f0-b17dd3c18115 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:08.945820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68ce43-a79f-4a42-99f0-b17dd3c18115 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:08.945820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68ce43-a79f-4a42-99f0-b17dd3c18115 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:08.947920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:08.955536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea83f8-359c-4b4f-a374-6508442da81b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:08.955978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea83f8-359c-4b4f-a374-6508442da81b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:08.956096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea83f8-359c-4b4f-a374-6508442da81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:09.037542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d7ea83f8-359c-4b4f-a374-6508442da81b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:09.038755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d7ea83f8-359c-4b4f-a374-6508442da81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:09.139601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:09.297543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68ce43-a79f-4a42-99f0-b17dd3c18115 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:09.300026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2f68ce43-a79f-4a42-99f0-b17dd3c18115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:09.394957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:09.462916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68ce43-a79f-4a42-99f0-b17dd3c18115 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:09.590415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284958b5-b1c8-4fcc-bf86-62690adb9930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:09.591323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284958b5-b1c8-4fcc-bf86-62690adb9930 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:09.591691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284958b5-b1c8-4fcc-bf86-62690adb9930 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:09.591964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284958b5-b1c8-4fcc-bf86-62690adb9930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:09.595000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-284958b5-b1c8-4fcc-bf86-62690adb9930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:09.651929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:09.695887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284958b5-b1c8-4fcc-bf86-62690adb9930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:09.697498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284958b5-b1c8-4fcc-bf86-62690adb9930 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:09.720583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 709/1428] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:10.527119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4713-6805-4e4b-a83b-f2dc12673aca None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:10.527722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4713-6805-4e4b-a83b-f2dc12673aca None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:10.527722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4713-6805-4e4b-a83b-f2dc12673aca None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:10.528953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:10.535515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1295bb-d132-4220-a755-065a1a0dcf93 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:10.536284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1295bb-d132-4220-a755-065a1a0dcf93 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:10.536394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1295bb-d132-4220-a755-065a1a0dcf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:10.633827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bf1295bb-d132-4220-a755-065a1a0dcf93 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:10.635076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bf1295bb-d132-4220-a755-065a1a0dcf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:10.742608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:10.900200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf4713-6805-4e4b-a83b-f2dc12673aca None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:10.901722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-32cf4713-6805-4e4b-a83b-f2dc12673aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:10.953232 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:11.084729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf4713-6805-4e4b-a83b-f2dc12673aca None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:11.205802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55d58b-abd9-49c5-a783-69504f045b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:11.206419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d58b-abd9-49c5-a783-69504f045b42 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:11.206689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d58b-abd9-49c5-a783-69504f045b42 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:11.206954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55d58b-abd9-49c5-a783-69504f045b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:11.208575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa55d58b-abd9-49c5-a783-69504f045b42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:11.215850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:11.304095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55d58b-abd9-49c5-a783-69504f045b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:11.305773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55d58b-abd9-49c5-a783-69504f045b42 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:11.326326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 721/1431] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:12.163709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e33d-5523-44ce-83bd-e2d776efbd8c None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:12.164315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e33d-5523-44ce-83bd-e2d776efbd8c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:12.164315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597e33d-5523-44ce-83bd-e2d776efbd8c None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:12.166292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:12.175959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae0b3-977c-4f11-be83-944b41b0254e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:12.176398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae0b3-977c-4f11-be83-944b41b0254e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:12.176787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae0b3-977c-4f11-be83-944b41b0254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:12.263319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5a0ae0b3-977c-4f11-be83-944b41b0254e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:12.264585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5a0ae0b3-977c-4f11-be83-944b41b0254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:12.336737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:12.369556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:12.532213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e33d-5523-44ce-83bd-e2d776efbd8c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:12.534520 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5597e33d-5523-44ce-83bd-e2d776efbd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:12.557621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:12.697200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597e33d-5523-44ce-83bd-e2d776efbd8c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:12.796131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:12.823801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86f58b-b200-45b8-a3cb-103f3c193d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:12.824422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86f58b-b200-45b8-a3cb-103f3c193d57 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:12.824697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86f58b-b200-45b8-a3cb-103f3c193d57 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:12.824966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86f58b-b200-45b8-a3cb-103f3c193d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:12.826556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9f86f58b-b200-45b8-a3cb-103f3c193d57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:12.940870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86f58b-b200-45b8-a3cb-103f3c193d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:12.942484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86f58b-b200-45b8-a3cb-103f3c193d57 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:12.962485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 712/1434] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:13.798117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd4c0-ba0c-40e9-9b89-e5d43779e54c None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:13.798733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd4c0-ba0c-40e9-9b89-e5d43779e54c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:13.798733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd4c0-ba0c-40e9-9b89-e5d43779e54c None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:13.800080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:13.806156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658b34e-0095-4a9f-9e03-c22454b4e352 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:13.806600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658b34e-0095-4a9f-9e03-c22454b4e352 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:13.806706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658b34e-0095-4a9f-9e03-c22454b4e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:13.889065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e658b34e-0095-4a9f-9e03-c22454b4e352 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:13.890278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e658b34e-0095-4a9f-9e03-c22454b4e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:13.933239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:13.996982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:14.150986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbd4c0-ba0c-40e9-9b89-e5d43779e54c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:14.152572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-18bbd4c0-ba0c-40e9-9b89-e5d43779e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:14.320774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbd4c0-ba0c-40e9-9b89-e5d43779e54c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:14.375690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:14.437969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702ec42-27b7-41e3-927f-aa25cd59f787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:14.438599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ec42-27b7-41e3-927f-aa25cd59f787 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:14.438859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ec42-27b7-41e3-927f-aa25cd59f787 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:14.439126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ec42-27b7-41e3-927f-aa25cd59f787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:14.440864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d702ec42-27b7-41e3-927f-aa25cd59f787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:14.538326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702ec42-27b7-41e3-927f-aa25cd59f787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:14.539995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702ec42-27b7-41e3-927f-aa25cd59f787 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:14.565388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 724/1437] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:15.379089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae584ee-1d54-4c5e-a6fb-4f8d0c13e3a9 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:15.380050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae584ee-1d54-4c5e-a6fb-4f8d0c13e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:15.380050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae584ee-1d54-4c5e-a6fb-4f8d0c13e3a9 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:15.382259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:33:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:15.388938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb382ae0-46cb-45eb-bac8-50021cd48702 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:15.389733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb382ae0-46cb-45eb-bac8-50021cd48702 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:15.389733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb382ae0-46cb-45eb-bac8-50021cd48702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:15.472176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eb382ae0-46cb-45eb-bac8-50021cd48702 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:15.473286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eb382ae0-46cb-45eb-bac8-50021cd48702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:15.475411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:15.576848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:15.736569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae584ee-1d54-4c5e-a6fb-4f8d0c13e3a9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:15.738116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0ae584ee-1d54-4c5e-a6fb-4f8d0c13e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:15.929416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae584ee-1d54-4c5e-a6fb-4f8d0c13e3a9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:15.967983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:16.091306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa7542-596d-40b1-ad91-49e7404b03fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:16.091970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa7542-596d-40b1-ad91-49e7404b03fb service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:16.092251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa7542-596d-40b1-ad91-49e7404b03fb service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:16.092524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa7542-596d-40b1-ad91-49e7404b03fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:16.094356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c1aa7542-596d-40b1-ad91-49e7404b03fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:16.214556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa7542-596d-40b1-ad91-49e7404b03fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:16.217186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa7542-596d-40b1-ad91-49e7404b03fb service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:16.248497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 715/1440] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:33:18.166007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61dee-d627-4aa4-87e4-59c4d70c0d5e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:18.166476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61dee-d627-4aa4-87e4-59c4d70c0d5e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:18.166592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb61dee-d627-4aa4-87e4-59c4d70c0d5e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:18.167976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:18.173563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecef7fa-d970-481b-bcc1-9af9906be96a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:18.174005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecef7fa-d970-481b-bcc1-9af9906be96a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:18.174110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecef7fa-d970-481b-bcc1-9af9906be96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:18.232580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:18.261196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4ecef7fa-d970-481b-bcc1-9af9906be96a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:18.262456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4ecef7fa-d970-481b-bcc1-9af9906be96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:18.371049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:18.653722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61dee-d627-4aa4-87e4-59c4d70c0d5e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:18.656802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2bb61dee-d627-4aa4-87e4-59c4d70c0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:18.777485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb61dee-d627-4aa4-87e4-59c4d70c0d5e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:18.818368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:18.863101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063655-1442-4d32-a9a6-2fe918b404c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:18.863732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063655-1442-4d32-a9a6-2fe918b404c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:18.864010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063655-1442-4d32-a9a6-2fe918b404c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:18.864281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063655-1442-4d32-a9a6-2fe918b404c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:18.865878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-45063655-1442-4d32-a9a6-2fe918b404c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:18.988226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063655-1442-4d32-a9a6-2fe918b404c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:18.989597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063655-1442-4d32-a9a6-2fe918b404c5 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:19.014047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 727/1443] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:21.177453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37933f1-2f38-4121-969a-da3ae8026bc0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:21.178331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37933f1-2f38-4121-969a-da3ae8026bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:21.178331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37933f1-2f38-4121-969a-da3ae8026bc0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:21.180406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:21.188910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e90373-c8a2-44dc-8e2c-68e989afff9f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:21.189391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e90373-c8a2-44dc-8e2c-68e989afff9f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:21.189493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e90373-c8a2-44dc-8e2c-68e989afff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:21.260006 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a9e90373-c8a2-44dc-8e2c-68e989afff9f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:21.261237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a9e90373-c8a2-44dc-8e2c-68e989afff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:21.274625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:21.368640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:33:21.660762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37933f1-2f38-4121-969a-da3ae8026bc0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:21.662428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d37933f1-2f38-4121-969a-da3ae8026bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:21.775597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37933f1-2f38-4121-969a-da3ae8026bc0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:21.789548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:21.852267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7c541-2493-49c1-b218-83ab300f78d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:21.852875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c541-2493-49c1-b218-83ab300f78d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:21.853144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c541-2493-49c1-b218-83ab300f78d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:21.853408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7c541-2493-49c1-b218-83ab300f78d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:21.855012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-19e7c541-2493-49c1-b218-83ab300f78d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:21.983884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c541-2493-49c1-b218-83ab300f78d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:21.985250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7c541-2493-49c1-b218-83ab300f78d6 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:22.006144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 718/1446] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:24.218530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20f6a-cd45-4bd6-9ba2-3734545083cc None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:24.219410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20f6a-cd45-4bd6-9ba2-3734545083cc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:24.219410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20f6a-cd45-4bd6-9ba2-3734545083cc None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:24.220789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:24.227518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc17b4-fbbf-41b4-9507-fe16aaf8e78f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:24.227964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc17b4-fbbf-41b4-9507-fe16aaf8e78f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:24.228122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc17b4-fbbf-41b4-9507-fe16aaf8e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:24.289371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:24.309368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2bbc17b4-fbbf-41b4-9507-fe16aaf8e78f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:24.310611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2bbc17b4-fbbf-41b4-9507-fe16aaf8e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:24.428401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:24.717141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20f6a-cd45-4bd6-9ba2-3734545083cc None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:24.719673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7ea20f6a-cd45-4bd6-9ba2-3734545083cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:24.837279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20f6a-cd45-4bd6-9ba2-3734545083cc None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:24.879249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:24.925045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08de467-ed55-4510-a9d8-c8c63128e30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:24.925660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de467-ed55-4510-a9d8-c8c63128e30a service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:24.925938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de467-ed55-4510-a9d8-c8c63128e30a service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:24.926204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08de467-ed55-4510-a9d8-c8c63128e30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:24.927866 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c08de467-ed55-4510-a9d8-c8c63128e30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:25.047858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08de467-ed55-4510-a9d8-c8c63128e30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:25.049933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08de467-ed55-4510-a9d8-c8c63128e30a service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:25.073998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 730/1449] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:27.132018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c020-b6ff-4678-a9e2-0fa8517b299b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:27.132956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c020-b6ff-4678-a9e2-0fa8517b299b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:27.132956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c020-b6ff-4678-a9e2-0fa8517b299b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:27.135370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:27.144712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769cfb3-19b9-41be-b9fc-0b759fc33a8a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:27.145430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769cfb3-19b9-41be-b9fc-0b759fc33a8a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:27.145623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769cfb3-19b9-41be-b9fc-0b759fc33a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:27.221739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c769cfb3-19b9-41be-b9fc-0b759fc33a8a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:27.222971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c769cfb3-19b9-41be-b9fc-0b759fc33a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:27.248234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:27.333217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:27.620468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c020-b6ff-4678-a9e2-0fa8517b299b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:27.622875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c605c020-b6ff-4678-a9e2-0fa8517b299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:27.745167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c020-b6ff-4678-a9e2-0fa8517b299b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:27.767141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:27.826448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c567d5-9f91-48d5-a588-0246ce34194d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:27.827066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c567d5-9f91-48d5-a588-0246ce34194d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:27.827343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c567d5-9f91-48d5-a588-0246ce34194d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:27.827626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c567d5-9f91-48d5-a588-0246ce34194d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:27.829505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b6c567d5-9f91-48d5-a588-0246ce34194d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:27.942872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c567d5-9f91-48d5-a588-0246ce34194d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:27.944271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c567d5-9f91-48d5-a588-0246ce34194d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:27.965771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 721/1452] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:29.947022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6a1c7-eb9f-4fca-8d2e-54f8d7789eb4 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:29.947979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6a1c7-eb9f-4fca-8d2e-54f8d7789eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:29.947979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6a1c7-eb9f-4fca-8d2e-54f8d7789eb4 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:29.950195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:29.957014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e860f-d8d9-434f-92a8-05e129bf6677 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:29.957673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e860f-d8d9-434f-92a8-05e129bf6677 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:29.957835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e860f-d8d9-434f-92a8-05e129bf6677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:30.040457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:30.043655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-625e860f-d8d9-434f-92a8-05e129bf6677 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:30.045638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-625e860f-d8d9-434f-92a8-05e129bf6677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:30.144575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:30.438218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6a1c7-eb9f-4fca-8d2e-54f8d7789eb4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:30.441082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fcf6a1c7-eb9f-4fca-8d2e-54f8d7789eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:30.561005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6a1c7-eb9f-4fca-8d2e-54f8d7789eb4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:30.614867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:30.646636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2fce0-9654-4cd3-978e-29792ec8314c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:30.647258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2fce0-9654-4cd3-978e-29792ec8314c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:30.647531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2fce0-9654-4cd3-978e-29792ec8314c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:30.647825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2fce0-9654-4cd3-978e-29792ec8314c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:30.649428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-82c2fce0-9654-4cd3-978e-29792ec8314c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:30.763945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2fce0-9654-4cd3-978e-29792ec8314c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:30.765400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2fce0-9654-4cd3-978e-29792ec8314c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:30.784004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 733/1455] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:32.769578 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862521-075b-41ee-8418-a71237321fb5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:32.770328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862521-075b-41ee-8418-a71237321fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:32.770328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862521-075b-41ee-8418-a71237321fb5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:32.772469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:32.780916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f6068-10b7-4caa-9ba9-e3db6be1d047 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:32.783378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f6068-10b7-4caa-9ba9-e3db6be1d047 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:32.783378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f6068-10b7-4caa-9ba9-e3db6be1d047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:32.857118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e05f6068-10b7-4caa-9ba9-e3db6be1d047 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:32.858345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e05f6068-10b7-4caa-9ba9-e3db6be1d047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:32.895836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:32.969359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:33.264985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9862521-075b-41ee-8418-a71237321fb5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:33.267517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f9862521-075b-41ee-8418-a71237321fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:33.388808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9862521-075b-41ee-8418-a71237321fb5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:33.418315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:33.466109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759b544-e259-4081-bbc1-1272886d508e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:33.466739 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759b544-e259-4081-bbc1-1272886d508e service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:33.467017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759b544-e259-4081-bbc1-1272886d508e service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:33.467285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759b544-e259-4081-bbc1-1272886d508e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:33.468920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3759b544-e259-4081-bbc1-1272886d508e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:33.599821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759b544-e259-4081-bbc1-1272886d508e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:33.601269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759b544-e259-4081-bbc1-1272886d508e service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:33.621342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 724/1458] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:35.621079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48974b5d-47aa-42b8-89ce-95b5600b2fff None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:35.621646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48974b5d-47aa-42b8-89ce-95b5600b2fff None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:35.621646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48974b5d-47aa-42b8-89ce-95b5600b2fff None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:35.623738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:35.631408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6df9a-8932-481b-a0f7-5a8703caf3f6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:35.632199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6df9a-8932-481b-a0f7-5a8703caf3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:35.632375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6df9a-8932-481b-a0f7-5a8703caf3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:35.702731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9dc6df9a-8932-481b-a0f7-5a8703caf3f6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:35.704157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9dc6df9a-8932-481b-a0f7-5a8703caf3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:35.712585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:35.816152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:36.097546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48974b5d-47aa-42b8-89ce-95b5600b2fff None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:36.099146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-48974b5d-47aa-42b8-89ce-95b5600b2fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:36.216476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48974b5d-47aa-42b8-89ce-95b5600b2fff None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:36.284981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:36.305032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2ec9-9ebf-4759-a58a-3e758bee61d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:36.305648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2ec9-9ebf-4759-a58a-3e758bee61d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:36.305929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2ec9-9ebf-4759-a58a-3e758bee61d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:36.306199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2ec9-9ebf-4759-a58a-3e758bee61d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:36.307865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-497e2ec9-9ebf-4759-a58a-3e758bee61d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:36.432624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2ec9-9ebf-4759-a58a-3e758bee61d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:36.433986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2ec9-9ebf-4759-a58a-3e758bee61d6 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:36.452407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 736/1461] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:38.439867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873a1e-8f18-43d9-ace4-e3e6ffe6f38f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:38.440415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873a1e-8f18-43d9-ace4-e3e6ffe6f38f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:38.440415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc873a1e-8f18-43d9-ace4-e3e6ffe6f38f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:38.442246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:38.448053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eeedb-86d1-476f-ac2c-1ce0e45c0f2f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:38.448457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eeedb-86d1-476f-ac2c-1ce0e45c0f2f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:38.448613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61eeedb-86d1-476f-ac2c-1ce0e45c0f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:38.534527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f61eeedb-86d1-476f-ac2c-1ce0e45c0f2f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:38.535808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f61eeedb-86d1-476f-ac2c-1ce0e45c0f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:38.575173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:38.638666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:38.926435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873a1e-8f18-43d9-ace4-e3e6ffe6f38f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:38.928021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bc873a1e-8f18-43d9-ace4-e3e6ffe6f38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:39.040594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc873a1e-8f18-43d9-ace4-e3e6ffe6f38f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:39.080512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:39.118134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748538f-62bd-458d-8a23-0361ee4ebb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:39.118743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748538f-62bd-458d-8a23-0361ee4ebb4d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:39.119017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748538f-62bd-458d-8a23-0361ee4ebb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:39.119283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748538f-62bd-458d-8a23-0361ee4ebb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:39.120908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5748538f-62bd-458d-8a23-0361ee4ebb4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:39.240017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748538f-62bd-458d-8a23-0361ee4ebb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:39.241501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748538f-62bd-458d-8a23-0361ee4ebb4d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:39.262014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 727/1464] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:33:41.207212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979fab2-336d-497a-a1ee-521e2fda2579 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:41.208178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979fab2-336d-497a-a1ee-521e2fda2579 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:41.208178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979fab2-336d-497a-a1ee-521e2fda2579 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:41.210756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:41.218714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56cdbc-d0cf-4a7d-86bd-db0f535fc9ec None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:41.219375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56cdbc-d0cf-4a7d-86bd-db0f535fc9ec None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:41.219375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56cdbc-d0cf-4a7d-86bd-db0f535fc9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:41.288576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0f56cdbc-d0cf-4a7d-86bd-db0f535fc9ec None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:41.289810 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0f56cdbc-d0cf-4a7d-86bd-db0f535fc9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:41.310971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:41.395978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:33:41.678646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979fab2-336d-497a-a1ee-521e2fda2579 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:41.681264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f979fab2-336d-497a-a1ee-521e2fda2579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:41.807197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979fab2-336d-497a-a1ee-521e2fda2579 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:41.875879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:41.888311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192c642-d594-4513-9263-4634b147e5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:41.888967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c642-d594-4513-9263-4634b147e5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:41.889245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c642-d594-4513-9263-4634b147e5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:41.889512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c642-d594-4513-9263-4634b147e5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:41.891319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4192c642-d594-4513-9263-4634b147e5d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:42.148153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192c642-d594-4513-9263-4634b147e5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:42.149639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192c642-d594-4513-9263-4634b147e5d0 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:42.169116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 739/1467] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:44.176536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff4086-8f01-4bd8-aeed-e4156ec3907d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:44.177202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff4086-8f01-4bd8-aeed-e4156ec3907d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:44.177202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff4086-8f01-4bd8-aeed-e4156ec3907d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:44.178446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:33:44.184005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9788-3758-4936-97c1-de4fa088d65d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:44.184464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9788-3758-4936-97c1-de4fa088d65d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:44.184566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c9788-3758-4936-97c1-de4fa088d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:44.261808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b21c9788-3758-4936-97c1-de4fa088d65d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:33:44.263060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b21c9788-3758-4936-97c1-de4fa088d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:44.317363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:44.368252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:33:44.665569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff4086-8f01-4bd8-aeed-e4156ec3907d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:33:44.668209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-07ff4086-8f01-4bd8-aeed-e4156ec3907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:44.807572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff4086-8f01-4bd8-aeed-e4156ec3907d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:33:44.861573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:44.895594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ee0ce-a5d4-456e-b345-1e50aa7cd382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:33:44.896348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee0ce-a5d4-456e-b345-1e50aa7cd382 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:33:44.896623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee0ce-a5d4-456e-b345-1e50aa7cd382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:33:44.896886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee0ce-a5d4-456e-b345-1e50aa7cd382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:33:44.898521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-387ee0ce-a5d4-456e-b345-1e50aa7cd382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:33:45.012874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ee0ce-a5d4-456e-b345-1e50aa7cd382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:33:45.014274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ee0ce-a5d4-456e-b345-1e50aa7cd382 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:33:45.033062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 730/1470] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:33:54.366075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=22 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:33:55.030641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=66 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:04.736747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680c7d-eeba-4dcb-aa27-eca79de6c906 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:04.737280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680c7d-eeba-4dcb-aa27-eca79de6c906 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:04.737280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680c7d-eeba-4dcb-aa27-eca79de6c906 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:04.738580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 741/1471] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:34:04.744611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482bcae-9c8c-4003-98ee-cf721ff274d4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:04.745055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482bcae-9c8c-4003-98ee-cf721ff274d4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:04.745176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482bcae-9c8c-4003-98ee-cf721ff274d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:04.826703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8482bcae-9c8c-4003-98ee-cf721ff274d4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:04.827964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8482bcae-9c8c-4003-98ee-cf721ff274d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:04.951603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 731/1472] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:34:05.248398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c4da-a316-460c-8d00-7c77ec768b84 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:05.248688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c4da-a316-460c-8d00-7c77ec768b84 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:05.248955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c4da-a316-460c-8d00-7c77ec768b84 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:05.250307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 742/1473] 10.222.0.88 () {54 vars in 967 bytes} [Wed Aug 24 16:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:34:05.255381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f30f-fc34-4bc0-8972-aa52560e4d57 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:05.255702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f30f-fc34-4bc0-8972-aa52560e4d57 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:05.255978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65f30f-fc34-4bc0-8972-aa52560e4d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:05.343436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9d65f30f-fc34-4bc0-8972-aa52560e4d57 None None] MFA Rules not processed for user `f0a331472a0040d68824a2245bf3e716`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:05.344697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9d65f30f-fc34-4bc0-8972-aa52560e4d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:05.365714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:05.436652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 732/1474] 10.222.0.88 () {58 vars in 1064 bytes} [Wed Aug 24 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:34:05.444645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7c4da-a316-460c-8d00-7c77ec768b84 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:34:05.446233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e8f7c4da-a316-460c-8d00-7c77ec768b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:05.554171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7c4da-a316-460c-8d00-7c77ec768b84 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:34:05.648626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839171f-c12c-42d5-972c-bc706b5656b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a331472a0040d68824a2245bf3e716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:34:05.649638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839171f-c12c-42d5-972c-bc706b5656b2 service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:05.649937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839171f-c12c-42d5-972c-bc706b5656b2 service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:05.650213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839171f-c12c-42d5-972c-bc706b5656b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:05.651860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6839171f-c12c-42d5-972c-bc706b5656b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:05.713962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:05.778639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839171f-c12c-42d5-972c-bc706b5656b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:34:05.780142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839171f-c12c-42d5-972c-bc706b5656b2 service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:34:05.801350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 743/1475] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:34:07.863833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfabe1-68e7-4b8b-8091-5460a4366c87 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:07.864922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfabe1-68e7-4b8b-8091-5460a4366c87 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:07.864922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfabe1-68e7-4b8b-8091-5460a4366c87 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:07.867021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 733/1476] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:34:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:34:07.874986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41b22c-4b96-428e-ae23-0907bd0b85e6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:07.875458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41b22c-4b96-428e-ae23-0907bd0b85e6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:07.875564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41b22c-4b96-428e-ae23-0907bd0b85e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:07.952721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ce41b22c-4b96-428e-ae23-0907bd0b85e6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:07.953942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ce41b22c-4b96-428e-ae23-0907bd0b85e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:08.063515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 744/1477] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:34:08.336039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfabe1-68e7-4b8b-8091-5460a4366c87 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:34:08.337772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-20cfabe1-68e7-4b8b-8091-5460a4366c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:08.483663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfabe1-68e7-4b8b-8091-5460a4366c87 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:34:08.544827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:08.593187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad87da-1d2a-4432-a4a7-44014df4a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:34:08.593716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad87da-1d2a-4432-a4a7-44014df4a030 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:08.594000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad87da-1d2a-4432-a4a7-44014df4a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:08.594259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad87da-1d2a-4432-a4a7-44014df4a030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:08.594888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad87da-1d2a-4432-a4a7-44014df4a030 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:34:08.596683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-44ad87da-1d2a-4432-a4a7-44014df4a030 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:34:08.596683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:34:08.596683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:34:08.597841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad87da-1d2a-4432-a4a7-44014df4a030 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:34:08.620069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 734/1478] 10.222.0.88 () {56 vars in 1108 bytes} [Wed Aug 24 16:34:08 2022] GET /identity/v3/projects => generated 2553 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:34:10.563153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6bc53-e43e-4272-8ee4-b5c66191be7b None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:10.563747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6bc53-e43e-4272-8ee4-b5c66191be7b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:10.563747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6bc53-e43e-4272-8ee4-b5c66191be7b None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:10.565070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 745/1479] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:34:10.570624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190669a-2735-4de2-bd9e-9758841895b9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:10.571116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190669a-2735-4de2-bd9e-9758841895b9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:10.571217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190669a-2735-4de2-bd9e-9758841895b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:10.646450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3190669a-2735-4de2-bd9e-9758841895b9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:10.647692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3190669a-2735-4de2-bd9e-9758841895b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:10.747458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 735/1480] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:34:11.049933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6bc53-e43e-4272-8ee4-b5c66191be7b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:34:11.051600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e6a6bc53-e43e-4272-8ee4-b5c66191be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:11.062418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:11.208308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6bc53-e43e-4272-8ee4-b5c66191be7b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:34:11.293545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:11.331204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afe1d2-fb36-42e3-87f1-c443c574fe9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:34:11.331863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afe1d2-fb36-42e3-87f1-c443c574fe9a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:11.332141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afe1d2-fb36-42e3-87f1-c443c574fe9a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:11.332412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afe1d2-fb36-42e3-87f1-c443c574fe9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:11.334037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-39afe1d2-fb36-42e3-87f1-c443c574fe9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:11.431109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afe1d2-fb36-42e3-87f1-c443c574fe9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:34:11.432770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afe1d2-fb36-42e3-87f1-c443c574fe9a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:34:11.452799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 746/1481] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:34:13.586158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a19b1-b8d7-41fa-bf66-9dbf996bc13a None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:13.586886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a19b1-b8d7-41fa-bf66-9dbf996bc13a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:13.587226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a19b1-b8d7-41fa-bf66-9dbf996bc13a None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:13.589452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 736/1482] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:34:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:34:13.597613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376653b-1c52-4e39-bf4f-aee0800778c0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:13.598083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376653b-1c52-4e39-bf4f-aee0800778c0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:13.598178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376653b-1c52-4e39-bf4f-aee0800778c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:13.667984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2376653b-1c52-4e39-bf4f-aee0800778c0 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:13.669238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2376653b-1c52-4e39-bf4f-aee0800778c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:13.723201 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:13.793940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 747/1483] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:34:14.094622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a19b1-b8d7-41fa-bf66-9dbf996bc13a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:34:14.097182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-780a19b1-b8d7-41fa-bf66-9dbf996bc13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:14.126384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:14.219759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a19b1-b8d7-41fa-bf66-9dbf996bc13a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:34:14.303719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308130c-a51c-4c12-99ee-aa0fa153d539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:34:14.304345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308130c-a51c-4c12-99ee-aa0fa153d539 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:14.304633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308130c-a51c-4c12-99ee-aa0fa153d539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:14.304884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308130c-a51c-4c12-99ee-aa0fa153d539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:14.306797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0308130c-a51c-4c12-99ee-aa0fa153d539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:14.400782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:14.440515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308130c-a51c-4c12-99ee-aa0fa153d539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:34:14.441961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308130c-a51c-4c12-99ee-aa0fa153d539 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:34:14.466283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 737/1484] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:34:16.418749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf4d7-92ab-4f38-bab9-319c61cee6d3 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:16.419331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf4d7-92ab-4f38-bab9-319c61cee6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:16.419331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cf4d7-92ab-4f38-bab9-319c61cee6d3 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:16.421421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 748/1485] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:34:16.430323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0c132-259e-412a-8a65-a9c1d9993f16 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:16.430753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0c132-259e-412a-8a65-a9c1d9993f16 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:16.430893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0c132-259e-412a-8a65-a9c1d9993f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:16.510351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-01c0c132-259e-412a-8a65-a9c1d9993f16 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:16.511573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-01c0c132-259e-412a-8a65-a9c1d9993f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:16.637656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 738/1486] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:34:16.931041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cf4d7-92ab-4f38-bab9-319c61cee6d3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:34:16.932991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ed6cf4d7-92ab-4f38-bab9-319c61cee6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:17.066648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cf4d7-92ab-4f38-bab9-319c61cee6d3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:34:17.154135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:17.156024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177a34f-182b-486b-b095-a74b5159e99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:34:17.156782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177a34f-182b-486b-b095-a74b5159e99e service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:17.157074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177a34f-182b-486b-b095-a74b5159e99e service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:17.157352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177a34f-182b-486b-b095-a74b5159e99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:17.160087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8177a34f-182b-486b-b095-a74b5159e99e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:17.278751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177a34f-182b-486b-b095-a74b5159e99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:34:17.280235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177a34f-182b-486b-b095-a74b5159e99e service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:34:17.300237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 749/1487] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:34:19.507415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0db65-dcbc-48cd-924f-ccb727de1d4f None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:19.508377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0db65-dcbc-48cd-924f-ccb727de1d4f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:19.508377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0db65-dcbc-48cd-924f-ccb727de1d4f None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:19.510086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 739/1488] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:34:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:34:19.515733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad09c1-6c08-48bf-8291-e398f34bb248 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:19.516174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad09c1-6c08-48bf-8291-e398f34bb248 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:19.516269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad09c1-6c08-48bf-8291-e398f34bb248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:19.595492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-71ad09c1-6c08-48bf-8291-e398f34bb248 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:19.596742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-71ad09c1-6c08-48bf-8291-e398f34bb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:19.660078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:19.707413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 750/1489] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:34:19.996269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0db65-dcbc-48cd-924f-ccb727de1d4f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:34:19.997836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ebe0db65-dcbc-48cd-924f-ccb727de1d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:20.038260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:20.110479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0db65-dcbc-48cd-924f-ccb727de1d4f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:34:20.191200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab28ec-079f-4faf-a8e0-d81b6d6072e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:34:20.191873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab28ec-079f-4faf-a8e0-d81b6d6072e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:20.192157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab28ec-079f-4faf-a8e0-d81b6d6072e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:20.192426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab28ec-079f-4faf-a8e0-d81b6d6072e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:20.194057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e2ab28ec-079f-4faf-a8e0-d81b6d6072e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:20.287315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:20.319242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab28ec-079f-4faf-a8e0-d81b6d6072e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:34:20.320748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab28ec-079f-4faf-a8e0-d81b6d6072e0 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:34:20.340416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 740/1490] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:34:22.433579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd296-bcce-4aa7-91c3-ab866f1ba93e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:22.434424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd296-bcce-4aa7-91c3-ab866f1ba93e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:22.434424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dd296-bcce-4aa7-91c3-ab866f1ba93e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:22.436627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 751/1491] 10.222.0.88 () {54 vars in 927 bytes} [Wed Aug 24 16:34:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:34:22.444979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ed65-7881-44f2-886e-ec62ef7e5d65 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:22.445461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ed65-7881-44f2-886e-ec62ef7e5d65 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:22.445461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5ed65-7881-44f2-886e-ec62ef7e5d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:22.514885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0ad5ed65-7881-44f2-886e-ec62ef7e5d65 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:34:22.516124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0ad5ed65-7881-44f2-886e-ec62ef7e5d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:22.614314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 741/1492] 10.222.0.88 () {58 vars in 1024 bytes} [Wed Aug 24 16:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:34:22.931304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd296-bcce-4aa7-91c3-ab866f1ba93e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:34:22.932901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-650dd296-bcce-4aa7-91c3-ab866f1ba93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:23.043886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dd296-bcce-4aa7-91c3-ab866f1ba93e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:34:23.119898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc6c74-b664-46de-a22d-40d303ca56c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:34:23.120513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6c74-b664-46de-a22d-40d303ca56c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:34:23.120784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6c74-b664-46de-a22d-40d303ca56c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:34:23.121052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6c74-b664-46de-a22d-40d303ca56c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:34:23.122635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-46fc6c74-b664-46de-a22d-40d303ca56c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:34:23.131998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:23.241053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc6c74-b664-46de-a22d-40d303ca56c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:34:23.242543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc6c74-b664-46de-a22d-40d303ca56c7 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:34:23.262417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 752/1493] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:34:32.612318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=82 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:34:33.260060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=50 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:37.748406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:37.749264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:37.749264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:37.829292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:35:37.830525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:37.935879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 742/1494] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:35:37.947902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda4d9c-249c-4df5-bb30-299ea2a35e3e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:37.948447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda4d9c-249c-4df5-bb30-299ea2a35e3e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:37.948447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda4d9c-249c-4df5-bb30-299ea2a35e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:38.034677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6bda4d9c-249c-4df5-bb30-299ea2a35e3e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:35:38.036393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6bda4d9c-249c-4df5-bb30-299ea2a35e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:38.156042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 753/1495] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:35:38.161078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:38.162303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:38.174275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695b71-d2ae-4df1-aade-4e7cdf60e473 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:38.242992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:38.278342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:38.278964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:38.279242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:38.279514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:38.280198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:35:38.280504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:38.281530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:38.281530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:35:38.281530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:35:38.282422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:38.294713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 743/1496] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:35:38.303356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda4d9c-249c-4df5-bb30-299ea2a35e3e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:38.313395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda4d9c-249c-4df5-bb30-299ea2a35e3e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:38.378661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:38.414847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:38.415458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:38.415764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:38.416030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:38.416647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:38.418478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:38.418478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 16:35:38.418478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: Aug 24 16:35:38.419729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:38.482171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 754/1497] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:35:38 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:35:38.486741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:38.488327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:38.522238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9499285-a687-404a-a806-18158a2dfd9a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:38.626170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:38.626782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:38.627062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:38.627328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:38.627977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:38.629000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:38.629000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:35:38.629000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:35:38.630238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:38.680805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 744/1498] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:35:38 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:35:38.686565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:38.688629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:38.757681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae250b8-2fcd-45c4-88a3-ae82318e6ab6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:38.839872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:38.851616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:38.852245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:38.852516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:38.852778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:38.853407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:38.854441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:38.854441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 16:35:38.854441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: Aug 24 16:35:38.855322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:38.867908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 755/1499] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:35:38.872329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:38.873863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:38.886240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742e9d-ee65-4af1-8707-06a93eec48ac admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:38.913665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:38.990045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d845351-7c3c-4024-a8ef-61d7d2cb6f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:38.990662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d845351-7c3c-4024-a8ef-61d7d2cb6f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:38.990935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d845351-7c3c-4024-a8ef-61d7d2cb6f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:38.991218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d845351-7c3c-4024-a8ef-61d7d2cb6f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:38.991962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d845351-7c3c-4024-a8ef-61d7d2cb6f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:38.992989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-0d845351-7c3c-4024-a8ef-61d7d2cb6f9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:38.992989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:35:38.992989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:35:38.993879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d845351-7c3c-4024-a8ef-61d7d2cb6f9d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:39.007214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 745/1500] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:35:39.014786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:39.017316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:39.057519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7565316-517b-4072-8d02-f228dff8d48a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:39.159232 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6b424-8a00-4760-b709-b9ec98d525fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:39.159848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6b424-8a00-4760-b709-b9ec98d525fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:39.160128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6b424-8a00-4760-b709-b9ec98d525fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:39.160404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6b424-8a00-4760-b709-b9ec98d525fa admin admin] PATH_INFO: `/v3/projects/3ef3274f82734626b2a275da9fa193bd/users/27cc5fc5002d40c693b7c727e03484f8/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:39.182416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6b424-8a00-4760-b709-b9ec98d525fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef3274f82734626b2a275da9fa193bd, user_id=27cc5fc5002d40c693b7c727e03484f8, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:39.183469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-70f6b424-8a00-4760-b709-b9ec98d525fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:39.183469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 16:35:39.183469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: Aug 24 16:35:39.185503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6b424-8a00-4760-b709-b9ec98d525fa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:39.212857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 756/1501] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:35:39 2022] PUT /identity/v3/projects/3ef3274f82734626b2a275da9fa193bd/users/27cc5fc5002d40c693b7c727e03484f8/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:35:39.225507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693562da-f8b8-42b6-839b-31977d5f46c4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:39.225784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693562da-f8b8-42b6-839b-31977d5f46c4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:39.226051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693562da-f8b8-42b6-839b-31977d5f46c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:39.295171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-693562da-f8b8-42b6-839b-31977d5f46c4 None None] MFA Rules not processed for user `27cc5fc5002d40c693b7c727e03484f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:35:39.296456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-693562da-f8b8-42b6-839b-31977d5f46c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:39.393611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 746/1502] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:35:39.407608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e555-8d66-4b4e-ac29-a1acaff19657 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:39.407933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e555-8d66-4b4e-ac29-a1acaff19657 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:39.408201 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165e555-8d66-4b4e-ac29-a1acaff19657 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:39.409625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 757/1503] 10.222.0.88 () {54 vars in 964 bytes} [Wed Aug 24 16:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:35:39.414833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed631bc-4022-4f76-940a-e72facb8a15b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:39.415118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed631bc-4022-4f76-940a-e72facb8a15b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:39.415394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed631bc-4022-4f76-940a-e72facb8a15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:39.448921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:39.503888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7ed631bc-4022-4f76-940a-e72facb8a15b None None] MFA Rules not processed for user `e6ef2398772541fa85ea0d46d6faf3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:35:39.505164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7ed631bc-4022-4f76-940a-e72facb8a15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:39.584582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 747/1504] 10.222.0.88 () {58 vars in 1061 bytes} [Wed Aug 24 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:35:39.592865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e555-8d66-4b4e-ac29-a1acaff19657 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:39.594375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1165e555-8d66-4b4e-ac29-a1acaff19657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:39.649520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:39.708211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165e555-8d66-4b4e-ac29-a1acaff19657 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:39.789105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:39.789749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:39.789994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:39.790283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:39.791971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:39.901235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:39.902921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:39.906492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:39.925412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 758/1505] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:35:39.971994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c09cb-cfe4-41c5-aabb-8b7a04dbd82e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:39.972463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c09cb-cfe4-41c5-aabb-8b7a04dbd82e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:39.972564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c09cb-cfe4-41c5-aabb-8b7a04dbd82e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:39.973904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 748/1506] 10.222.0.88 () {52 vars in 830 bytes} [Wed Aug 24 16:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:35:39.977720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:39.978944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:40.094308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40756966-daec-462a-8710-ffb602bfa018 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:40.206916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:40.207558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:40.207869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:40.208137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] PATH_INFO: `/v3/users/27cc5fc5002d40c693b7c727e03484f8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:40.221900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cc5fc5002d40c693b7c727e03484f8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:40.222901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:40.222901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 16:35:40.222901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: Aug 24 16:35:40.224288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:40.235060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:40.299284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cc5fc5002d40c693b7c727e03484f8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:40.299782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cc5fc5002d40c693b7c727e03484f8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:40.317305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cc5fc5002d40c693b7c727e03484f8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:40.317897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cc5fc5002d40c693b7c727e03484f8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:40.330266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cc5fc5002d40c693b7c727e03484f8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:40.360200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 759/1507] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:35:39 2022] DELETE /identity/v3/users/27cc5fc5002d40c693b7c727e03484f8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:35:40.364912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:40.365217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:40.365494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:40.426745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:35:40.428036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:40.515505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:40.529988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 749/1508] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:35:40.541204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:40.542432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:40.650167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89a5d4-803d-4941-a082-aa08d73c4972 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:40.709309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:40.732839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f7a37-c68c-4f7a-8146-4c552ab0f4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:40.733457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f7a37-c68c-4f7a-8146-4c552ab0f4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:40.733730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f7a37-c68c-4f7a-8146-4c552ab0f4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:40.734009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f7a37-c68c-4f7a-8146-4c552ab0f4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:40.735612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f37f7a37-c68c-4f7a-8146-4c552ab0f4c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:40.848222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f7a37-c68c-4f7a-8146-4c552ab0f4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:40.849714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f7a37-c68c-4f7a-8146-4c552ab0f4c4 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:40.868607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 760/1509] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:35:41.220662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:35:41.221926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:35:41.233851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7853dc-1469-4c4e-871e-52c74feec967 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:35:41.334523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:35:41.335177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:35:41.335451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:35:41.335753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] PATH_INFO: `/v3/projects/3ef3274f82734626b2a275da9fa193bd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:35:41.346756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef3274f82734626b2a275da9fa193bd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:35:41.347868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:35:41.347868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:35:41.347868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:35:41.349080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:35:41.412181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef3274f82734626b2a275da9fa193bd', 'request_id': 'req-434bd191-7b12-47b1-a536-5974b77553f8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:41.425334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef3274f82734626b2a275da9fa193bd', 'request_id': 'req-434bd191-7b12-47b1-a536-5974b77553f8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:41.438756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef3274f82734626b2a275da9fa193bd', 'request_id': 'req-434bd191-7b12-47b1-a536-5974b77553f8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:41.464151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] The token cache is being invalidate because project 3ef3274f82734626b2a275da9fa193bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:35:41.464449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:41.464886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-434bd191-7b12-47b1-a536-5974b77553f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:35:41.466374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 750/1510] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:35:41 2022] DELETE /identity/v3/projects/3ef3274f82734626b2a275da9fa193bd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:35:50.866128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=62 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:35:51.462043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:19.632851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8092ce-a87e-4a9c-8d60-db4f5bd6dd5a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:19.633760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8092ce-a87e-4a9c-8d60-db4f5bd6dd5a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:19.633760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8092ce-a87e-4a9c-8d60-db4f5bd6dd5a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:19.635853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:37:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:19.643614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c004f5-3695-489d-a6fe-d6d23377bef9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:19.644101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c004f5-3695-489d-a6fe-d6d23377bef9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:19.644200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c004f5-3695-489d-a6fe-d6d23377bef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:19.734571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-90c004f5-3695-489d-a6fe-d6d23377bef9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:19.735842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-90c004f5-3695-489d-a6fe-d6d23377bef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:19.869015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:37:20.025444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8092ce-a87e-4a9c-8d60-db4f5bd6dd5a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:20.027933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5d8092ce-a87e-4a9c-8d60-db4f5bd6dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:20.174554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8092ce-a87e-4a9c-8d60-db4f5bd6dd5a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:20.181198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13eaaf-0e14-40c0-bbfb-1be95de03247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:20.181812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13eaaf-0e14-40c0-bbfb-1be95de03247 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:20.182091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13eaaf-0e14-40c0-bbfb-1be95de03247 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:20.182375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13eaaf-0e14-40c0-bbfb-1be95de03247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:20.192051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13eaaf-0e14-40c0-bbfb-1be95de03247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:20.194755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13eaaf-0e14-40c0-bbfb-1be95de03247 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:20.207071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 762/1513] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:21.122363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8e824-7fa1-4a83-acb1-d0d37ae527c2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:21.123200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8e824-7fa1-4a83-acb1-d0d37ae527c2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:21.123200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8e824-7fa1-4a83-acb1-d0d37ae527c2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:21.124586 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:21.130286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ae09e-244e-4f76-a092-3d6c760ccb50 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:21.130813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ae09e-244e-4f76-a092-3d6c760ccb50 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:21.131077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ae09e-244e-4f76-a092-3d6c760ccb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:21.155370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-862ae09e-244e-4f76-a092-3d6c760ccb50 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:21.156644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-862ae09e-244e-4f76-a092-3d6c760ccb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:21.168180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:21.337269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8e824-7fa1-4a83-acb1-d0d37ae527c2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:21.352972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8e824-7fa1-4a83-acb1-d0d37ae527c2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:21.359341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f9bff-dfb0-41f2-841b-0cfe562a6a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:21.359993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f9bff-dfb0-41f2-841b-0cfe562a6a8e service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:21.360304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f9bff-dfb0-41f2-841b-0cfe562a6a8e service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:21.360552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f9bff-dfb0-41f2-841b-0cfe562a6a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:21.370622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f9bff-dfb0-41f2-841b-0cfe562a6a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:21.372320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f9bff-dfb0-41f2-841b-0cfe562a6a8e service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:21.386186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 753/1516] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:21.701201 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b2c0-b08e-439c-ba34-12917dc3e294 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:21.701480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b2c0-b08e-439c-ba34-12917dc3e294 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:21.701932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b2c0-b08e-439c-ba34-12917dc3e294 None None] PATH_INFO: `/v3` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:21.703329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 764/1517] 10.222.0.73 () {54 vars in 925 bytes} [Wed Aug 24 16:37:21 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:37:21.711383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd94ab-67eb-47f6-ae54-5c2494a4b0a9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:21.711631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd94ab-67eb-47f6-ae54-5c2494a4b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:21.711929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd94ab-67eb-47f6-ae54-5c2494a4b0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:21.781897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-51fd94ab-67eb-47f6-ae54-5c2494a4b0a9 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:21.783127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-51fd94ab-67eb-47f6-ae54-5c2494a4b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:21.808739 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:21.881161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 754/1518] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Aug 24 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:25.776807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ec47-60bc-4b82-83d5-f6b76ab6c630 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:25.777399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ec47-60bc-4b82-83d5-f6b76ab6c630 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:25.777399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ec47-60bc-4b82-83d5-f6b76ab6c630 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:25.778874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 765/1519] 10.222.0.88 () {54 vars in 961 bytes} [Wed Aug 24 16:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:25.784033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc466-e2aa-4263-95d4-651d5d2e8b84 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:25.784479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc466-e2aa-4263-95d4-651d5d2e8b84 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:25.784590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dc466-e2aa-4263-95d4-651d5d2e8b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:25.806904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ff9dc466-e2aa-4263-95d4-651d5d2e8b84 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:25.808254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ff9dc466-e2aa-4263-95d4-651d5d2e8b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:25.818321 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 755/1520] 10.222.0.88 () {58 vars in 1058 bytes} [Wed Aug 24 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:25.826424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07ec47-60bc-4b82-83d5-f6b76ab6c630 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:25.841644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07ec47-60bc-4b82-83d5-f6b76ab6c630 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:25.847216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6d37d-30a9-4f5d-a796-3474e8c90727 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:25.847822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6d37d-30a9-4f5d-a796-3474e8c90727 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:25.848095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6d37d-30a9-4f5d-a796-3474e8c90727 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:25.848362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6d37d-30a9-4f5d-a796-3474e8c90727 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:25.857038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6d37d-30a9-4f5d-a796-3474e8c90727 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:25.858625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6d37d-30a9-4f5d-a796-3474e8c90727 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:25.868066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 766/1521] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:32.667402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc2f6-062e-49b3-ac7f-6a1ac71421b6 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:32.668335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc2f6-062e-49b3-ac7f-6a1ac71421b6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:32.668335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc2f6-062e-49b3-ac7f-6a1ac71421b6 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:32.670269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:37:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:32.678633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a976a8-b776-49df-aa17-32bc34dbd3ed None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:32.679408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a976a8-b776-49df-aa17-32bc34dbd3ed None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:32.679408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a976a8-b776-49df-aa17-32bc34dbd3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:32.701516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e0a976a8-b776-49df-aa17-32bc34dbd3ed None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:32.702714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e0a976a8-b776-49df-aa17-32bc34dbd3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:32.712092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:32.874715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc2f6-062e-49b3-ac7f-6a1ac71421b6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:32.892903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc2f6-062e-49b3-ac7f-6a1ac71421b6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:32.898983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364568f-48c1-477a-91d9-acdcd9c20f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:32.899612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364568f-48c1-477a-91d9-acdcd9c20f50 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:32.899890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364568f-48c1-477a-91d9-acdcd9c20f50 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:32.900165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364568f-48c1-477a-91d9-acdcd9c20f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:32.908577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364568f-48c1-477a-91d9-acdcd9c20f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:32.910176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364568f-48c1-477a-91d9-acdcd9c20f50 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:32.919751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 757/1524] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:33.740176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4a0c-a07b-4848-819c-332587bf932d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:33.740735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4a0c-a07b-4848-819c-332587bf932d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:33.740735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac4a0c-a07b-4848-819c-332587bf932d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:33.742022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 16:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:33.748028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805d21-50a5-4207-b64e-a5b3f4ad83a9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:33.748502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805d21-50a5-4207-b64e-a5b3f4ad83a9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:33.748599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805d21-50a5-4207-b64e-a5b3f4ad83a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:33.774371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9c805d21-50a5-4207-b64e-a5b3f4ad83a9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:33.775599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9c805d21-50a5-4207-b64e-a5b3f4ad83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:33.784885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 16:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:33.940317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4a0c-a07b-4848-819c-332587bf932d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:33.959377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac4a0c-a07b-4848-819c-332587bf932d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:33.966393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0bf2f-759b-4d48-a518-8eb7b0694ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:33.966988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0bf2f-759b-4d48-a518-8eb7b0694ec9 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:33.967259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0bf2f-759b-4d48-a518-8eb7b0694ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:33.967523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0bf2f-759b-4d48-a518-8eb7b0694ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:33.976232 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0bf2f-759b-4d48-a518-8eb7b0694ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:33.977835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0bf2f-759b-4d48-a518-8eb7b0694ec9 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:33.987482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 769/1527] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:37.815647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2533-b49c-4e9c-a0ea-101730ca579e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:37.816446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2533-b49c-4e9c-a0ea-101730ca579e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:37.816446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2533-b49c-4e9c-a0ea-101730ca579e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:37.818698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:37.828346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5687-f649-4318-9bf7-2a33958fef92 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:37.829096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5687-f649-4318-9bf7-2a33958fef92 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:37.829256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa5687-f649-4318-9bf7-2a33958fef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:37.853972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-94aa5687-f649-4318-9bf7-2a33958fef92 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:37.855176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-94aa5687-f649-4318-9bf7-2a33958fef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:37.863763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:38.156454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d2533-b49c-4e9c-a0ea-101730ca579e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:38.159641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bb5d2533-b49c-4e9c-a0ea-101730ca579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:38.254305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d2533-b49c-4e9c-a0ea-101730ca579e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:38.258555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0777e3e-998d-4646-bee4-7b198a5838bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:38.259181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0777e3e-998d-4646-bee4-7b198a5838bb service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:38.259464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0777e3e-998d-4646-bee4-7b198a5838bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:38.259772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0777e3e-998d-4646-bee4-7b198a5838bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:38.269927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0777e3e-998d-4646-bee4-7b198a5838bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:38.271372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0777e3e-998d-4646-bee4-7b198a5838bb service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:38.280984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 760/1530] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:40.179028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4000e0-9be3-42ca-99ae-7e270f54c4f2 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:40.179470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4000e0-9be3-42ca-99ae-7e270f54c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:40.179569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4000e0-9be3-42ca-99ae-7e270f54c4f2 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:40.181145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:40.189788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688101-380d-4f52-8efb-1deea8229dbc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:40.190288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688101-380d-4f52-8efb-1deea8229dbc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:40.190388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a688101-380d-4f52-8efb-1deea8229dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:40.212513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8a688101-380d-4f52-8efb-1deea8229dbc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:40.213757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8a688101-380d-4f52-8efb-1deea8229dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:40.222617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:40.508602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4000e0-9be3-42ca-99ae-7e270f54c4f2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:40.523317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4000e0-9be3-42ca-99ae-7e270f54c4f2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:40.527642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10061a-136d-473a-b74d-b3070e9f549c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:40.528245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10061a-136d-473a-b74d-b3070e9f549c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:40.529031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10061a-136d-473a-b74d-b3070e9f549c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:40.529316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10061a-136d-473a-b74d-b3070e9f549c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:40.539436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10061a-136d-473a-b74d-b3070e9f549c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:40.540951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10061a-136d-473a-b74d-b3070e9f549c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:40.551997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 772/1533] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:44.096447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9513d5-0926-4ea3-92d6-1c0afb64fb5e None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:44.097355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9513d5-0926-4ea3-92d6-1c0afb64fb5e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:44.097355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9513d5-0926-4ea3-92d6-1c0afb64fb5e None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:44.099414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:37:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:44.104953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abf3cd-29fc-4df7-8bef-03f10354b400 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:44.105389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abf3cd-29fc-4df7-8bef-03f10354b400 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:44.105506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abf3cd-29fc-4df7-8bef-03f10354b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:44.113778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=81 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:44.128694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-87abf3cd-29fc-4df7-8bef-03f10354b400 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:44.129896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-87abf3cd-29fc-4df7-8bef-03f10354b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:44.139608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:44.686027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9513d5-0926-4ea3-92d6-1c0afb64fb5e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:44.688308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5a9513d5-0926-4ea3-92d6-1c0afb64fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:44.768508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:44.788855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9513d5-0926-4ea3-92d6-1c0afb64fb5e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:44.796848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a09e37-c434-4160-966c-4db58941e5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:44.798483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a09e37-c434-4160-966c-4db58941e5ab service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:44.798483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a09e37-c434-4160-966c-4db58941e5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:44.798750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a09e37-c434-4160-966c-4db58941e5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:44.811091 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a09e37-c434-4160-966c-4db58941e5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:44.812574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a09e37-c434-4160-966c-4db58941e5ab service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:44.823048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 763/1536] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:46.740102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244302-845f-4f22-8366-7a3263ec8c1e None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:46.740820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244302-845f-4f22-8366-7a3263ec8c1e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:46.740820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244302-845f-4f22-8366-7a3263ec8c1e None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:46.742176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 16:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:37:46.748857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050b22c-2f81-4035-9fd9-c826334ecf5b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:46.749620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050b22c-2f81-4035-9fd9-c826334ecf5b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:46.749719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050b22c-2f81-4035-9fd9-c826334ecf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:46.771299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d050b22c-2f81-4035-9fd9-c826334ecf5b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:37:46.772564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d050b22c-2f81-4035-9fd9-c826334ecf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:46.781664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:37:47.356300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244302-845f-4f22-8366-7a3263ec8c1e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:37:47.358150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1d244302-845f-4f22-8366-7a3263ec8c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:37:47.371958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244302-845f-4f22-8366-7a3263ec8c1e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:37:47.376408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db6a38-237b-4177-8485-2f9b11d8b2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:37:47.377018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db6a38-237b-4177-8485-2f9b11d8b2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:37:47.377340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db6a38-237b-4177-8485-2f9b11d8b2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:37:47.377617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db6a38-237b-4177-8485-2f9b11d8b2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:37:47.387601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db6a38-237b-4177-8485-2f9b11d8b2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:37:47.389062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db6a38-237b-4177-8485-2f9b11d8b2e4 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:37:47.399142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 775/1539] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:37:56.765822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=11 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:37:57.395060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=8 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:14.228920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297caff-a6ec-4b21-ad23-156b173d1535 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.242383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297caff-a6ec-4b21-ad23-156b173d1535 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.242383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297caff-a6ec-4b21-ad23-156b173d1535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.261897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f297caff-a6ec-4b21-ad23-156b173d1535 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:14.263906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f297caff-a6ec-4b21-ad23-156b173d1535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:14.275799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 765/1540] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:39:14.285392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce19ee-79af-40c1-ac37-a3af89d8ef30 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.285995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce19ee-79af-40c1-ac37-a3af89d8ef30 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.285995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce19ee-79af-40c1-ac37-a3af89d8ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.314162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-95ce19ee-79af-40c1-ac37-a3af89d8ef30 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:14.315509 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-95ce19ee-79af-40c1-ac37-a3af89d8ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:14.332341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 776/1541] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:14.338921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297caff-a6ec-4b21-ad23-156b173d1535 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:14.355333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297caff-a6ec-4b21-ad23-156b173d1535 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:14.366958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:14.367729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.368007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.368273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.368928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:14.369223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:14.371122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:14.393073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 766/1542] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:14.402287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce19ee-79af-40c1-ac37-a3af89d8ef30 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:14.416943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce19ee-79af-40c1-ac37-a3af89d8ef30 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:14.423518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:14.424424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.424909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.425388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.426242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:14.428396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:14.491718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 777/1543] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:14 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:14.495675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:14.514524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ba058-e924-4a5e-9bac-7b48881afd18 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:14.610217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:14.611650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.611946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.612223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.612930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:14.615015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:14.657337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 767/1544] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:14 2022] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:14.661795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:14.676585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f32e9-8657-4459-abd6-84eb9cdd58f6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:14.684001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:14.685168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.685659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.686152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.687086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:14.689058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:14.704234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 778/1545] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:14.708590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:14.721529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ccda-b355-4177-80e5-e213f26adeef admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:14.732212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd4358-c75f-429e-ad0c-4fd6d929c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:14.733001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd4358-c75f-429e-ad0c-4fd6d929c454 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.733285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd4358-c75f-429e-ad0c-4fd6d929c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.733557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd4358-c75f-429e-ad0c-4fd6d929c454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.734220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd4358-c75f-429e-ad0c-4fd6d929c454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:14.735885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd4358-c75f-429e-ad0c-4fd6d929c454 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:14.751035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 768/1546] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:14.755294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:14.771882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6f441-85a3-4a67-9c75-92b3dc8e354a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:14.780020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8adcf-7cbb-4e0a-91a7-9dc02a156339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:14.781132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8adcf-7cbb-4e0a-91a7-9dc02a156339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.781628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8adcf-7cbb-4e0a-91a7-9dc02a156339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.782135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8adcf-7cbb-4e0a-91a7-9dc02a156339 admin admin] PATH_INFO: `/v3/projects/67ddc8036680484cae37a9ad0e04759e/users/6174776adacc42afbbf86d3be4ea747c/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.810235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8adcf-7cbb-4e0a-91a7-9dc02a156339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ddc8036680484cae37a9ad0e04759e, user_id=6174776adacc42afbbf86d3be4ea747c, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:14.813295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8adcf-7cbb-4e0a-91a7-9dc02a156339 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:14.849152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 779/1547] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:14 2022] PUT /identity/v3/projects/67ddc8036680484cae37a9ad0e04759e/users/6174776adacc42afbbf86d3be4ea747c/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:14.863905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190746b9-a8e5-4ff9-acf3-4b752851b665 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.864276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190746b9-a8e5-4ff9-acf3-4b752851b665 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.864460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190746b9-a8e5-4ff9-acf3-4b752851b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.894381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2907dde-a1a5-4f5f-93e7-f8cb558f60a7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:14.895043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2907dde-a1a5-4f5f-93e7-f8cb558f60a7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:14.895565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2907dde-a1a5-4f5f-93e7-f8cb558f60a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:14.908276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-190746b9-a8e5-4ff9-acf3-4b752851b665 None None] MFA Rules not processed for user `6174776adacc42afbbf86d3be4ea747c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:14.909592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-190746b9-a8e5-4ff9-acf3-4b752851b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:14.933417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a2907dde-a1a5-4f5f-93e7-f8cb558f60a7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:14.934819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a2907dde-a1a5-4f5f-93e7-f8cb558f60a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.056762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 769/1548] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.058378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eafcf-e33c-446f-80f1-fabcbc5b2615 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.058660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eafcf-e33c-446f-80f1-fabcbc5b2615 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.058935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846eafcf-e33c-446f-80f1-fabcbc5b2615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.074016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 780/1549] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:39:15.075529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755df81-0e1a-4d36-8bde-73373f8fef8e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.075911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755df81-0e1a-4d36-8bde-73373f8fef8e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.076186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755df81-0e1a-4d36-8bde-73373f8fef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.096278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-846eafcf-e33c-446f-80f1-fabcbc5b2615 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.098061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-846eafcf-e33c-446f-80f1-fabcbc5b2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.102940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c755df81-0e1a-4d36-8bde-73373f8fef8e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.104631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c755df81-0e1a-4d36-8bde-73373f8fef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.107648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 770/1550] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.108835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eafcf-e33c-446f-80f1-fabcbc5b2615 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.127260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 781/1551] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.128652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f720-a3a9-40f1-8397-9d3ee134963e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.128940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f720-a3a9-40f1-8397-9d3ee134963e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.129213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f720-a3a9-40f1-8397-9d3ee134963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.149591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7841f720-a3a9-40f1-8397-9d3ee134963e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.150805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7841f720-a3a9-40f1-8397-9d3ee134963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.159287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 782/1552] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.160526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0f1b-6bb7-481d-9867-f5864090267f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.160807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0f1b-6bb7-481d-9867-f5864090267f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.161081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef0f1b-6bb7-481d-9867-f5864090267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.163443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.175031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846eafcf-e33c-446f-80f1-fabcbc5b2615 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.178902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52d48d-5d9e-4545-882a-38af3c329f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.179510 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d48d-5d9e-4545-882a-38af3c329f99 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.179822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d48d-5d9e-4545-882a-38af3c329f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.180096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52d48d-5d9e-4545-882a-38af3c329f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.181533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9aef0f1b-6bb7-481d-9867-f5864090267f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.182756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9aef0f1b-6bb7-481d-9867-f5864090267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.188617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d48d-5d9e-4545-882a-38af3c329f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.190042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52d48d-5d9e-4545-882a-38af3c329f99 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.191109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 783/1553] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.198757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2333eb5-5168-4a0f-b01f-221505e08900 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.198757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2333eb5-5168-4a0f-b01f-221505e08900 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.198757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2333eb5-5168-4a0f-b01f-221505e08900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.199521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 771/1554] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:15.200845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0413-1fef-4b61-b08b-1662b50b1042 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.201126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0413-1fef-4b61-b08b-1662b50b1042 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.201396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0413-1fef-4b61-b08b-1662b50b1042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.214131 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b2333eb5-5168-4a0f-b01f-221505e08900 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.216285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b2333eb5-5168-4a0f-b01f-221505e08900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.221481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-df3d0413-1fef-4b61-b08b-1662b50b1042 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.222769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-df3d0413-1fef-4b61-b08b-1662b50b1042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.225340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 784/1555] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.226614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641084-b103-4084-891a-4b7fb95bdfce None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.226897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641084-b103-4084-891a-4b7fb95bdfce None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.227164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82641084-b103-4084-891a-4b7fb95bdfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.234556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 772/1556] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.236147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd9ae7-80b7-4f38-b54d-053d532d6281 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.236708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd9ae7-80b7-4f38-b54d-053d532d6281 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.237036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd9ae7-80b7-4f38-b54d-053d532d6281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.248921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-82641084-b103-4084-891a-4b7fb95bdfce None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.250389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-82641084-b103-4084-891a-4b7fb95bdfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.258227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8fdd9ae7-80b7-4f38-b54d-053d532d6281 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.259403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8fdd9ae7-80b7-4f38-b54d-053d532d6281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.259882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 785/1557] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.261330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec25d-d8ba-41a3-a263-6c0fb6b744c0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.261635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec25d-d8ba-41a3-a263-6c0fb6b744c0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.261907 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec25d-d8ba-41a3-a263-6c0fb6b744c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.274187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 773/1558] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.275329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd9ae7-80b7-4f38-b54d-053d532d6281 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.285964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8a0ec25d-d8ba-41a3-a263-6c0fb6b744c0 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.287155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8a0ec25d-d8ba-41a3-a263-6c0fb6b744c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.289110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd9ae7-80b7-4f38-b54d-053d532d6281 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.295225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 786/1559] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.296477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7c12b-f2b2-48d3-8d9a-e02f3c555a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.296633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849911d-93de-47b7-868a-2e8470b85b52 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.296790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849911d-93de-47b7-868a-2e8470b85b52 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.297031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849911d-93de-47b7-868a-2e8470b85b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.297736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7c12b-f2b2-48d3-8d9a-e02f3c555a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.298196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7c12b-f2b2-48d3-8d9a-e02f3c555a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.299020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7c12b-f2b2-48d3-8d9a-e02f3c555a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.299973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7c12b-f2b2-48d3-8d9a-e02f3c555a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:15.300480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7c12b-f2b2-48d3-8d9a-e02f3c555a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.302292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7c12b-f2b2-48d3-8d9a-e02f3c555a09 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.326927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 774/1560] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:15.326927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1e9c-63ff-4b7f-bc0c-7aa0539d1e14 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.326927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1e9c-63ff-4b7f-bc0c-7aa0539d1e14 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.326927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1e9c-63ff-4b7f-bc0c-7aa0539d1e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.328145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e849911d-93de-47b7-868a-2e8470b85b52 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.329647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e849911d-93de-47b7-868a-2e8470b85b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.337909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 787/1561] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.340657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849911d-93de-47b7-868a-2e8470b85b52 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.346666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-499d1e9c-63ff-4b7f-bc0c-7aa0539d1e14 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.347825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-499d1e9c-63ff-4b7f-bc0c-7aa0539d1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.352308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849911d-93de-47b7-868a-2e8470b85b52 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.356661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 775/1562] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.357966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125acec-5b7d-48f1-bdb0-5584d395126d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.358256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125acec-5b7d-48f1-bdb0-5584d395126d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.358672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125acec-5b7d-48f1-bdb0-5584d395126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.361014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.362088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.362725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.363208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.364370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:15.364944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.366248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:39:15.366248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 16:39:15.366248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: Aug 24 16:39:15.369013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.379421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c125acec-5b7d-48f1-bdb0-5584d395126d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.380674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c125acec-5b7d-48f1-bdb0-5584d395126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.383759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 788/1563] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:15.384824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.402345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 776/1564] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.402345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e81d-1d58-46b3-8456-4cd0224d9780 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.402345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e81d-1d58-46b3-8456-4cd0224d9780 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.402345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161e81d-1d58-46b3-8456-4cd0224d9780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.402695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec716-337e-429d-be53-58b4377ba08e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.407478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.408302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.408643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.408982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.409866 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:15.411044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.412770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.421831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0161e81d-1d58-46b3-8456-4cd0224d9780 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:15.424272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0161e81d-1d58-46b3-8456-4cd0224d9780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:15.425886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 789/1565] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:15.427197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.438478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffae5d6-b44c-4084-beff-1321ae18167e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.441823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 777/1566] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:15.443518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e81d-1d58-46b3-8456-4cd0224d9780 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.444012 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.444662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.444940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.445209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.446243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.448404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.458032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161e81d-1d58-46b3-8456-4cd0224d9780 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.462941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.463552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.463852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.464147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.465061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:15.465366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.466977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.467190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.487827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 790/1568] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:15.487827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.488151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 778/1568] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:15.489269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.502020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d1656-7087-4a0e-af15-75cc4f26ff54 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.557321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73242d-42a3-42a8-9d7f-2cf3c2fefd1f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.560907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.561529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.561809 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.562078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.562631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.562768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.563353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.563723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.563848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:39:15.563848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:39:15.563848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:39:15.564046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.564950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:15.565049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.565251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.568226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.584372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 791/1569] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:15.585333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.596432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc7ac-bde2-4e81-b4ad-fa596436a85e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.601422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.605788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 779/1570] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:15.605974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.605974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.606128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.606220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.606220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:15.606220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.606220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.619886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 792/1571] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:15.620779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.633803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91710b2a-cd83-4fc5-ba73-be9fe9e20288 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.676888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce0fb-74fd-4943-92e7-9cb073234f91 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.681959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.682579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.682993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.683415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.684205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.686192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.705145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.716171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.716886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.717291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.717495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.718212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:15.718521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.720251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.726930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 780/1572] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:15.728011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.737421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 793/1573] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:15.746048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.757293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b885b-700c-43cc-ab3e-c667ad72d3aa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.817076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7c929-4652-4023-9b54-2bb95ae0a744 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.821870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.822522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.822813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.823090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.823890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.826148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.834164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.834786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.835091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.835361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.836449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.837507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:39:15.837507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 16:39:15.837507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: Aug 24 16:39:15.839266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.859759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:15.870610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 781/1574] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:15.870811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 794/1575] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:15.870940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.871048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.887434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78ea1c-0117-4036-bb3f-f838e10bd052 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.947120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87a3e1-34b7-4160-987a-0743751c1507 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.953086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.953284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:15.953667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.953814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:15.953941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.954040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:15.954207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.954303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:15.954830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.954945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:15.956766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.956884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:15.980075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 795/1576] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:15.980991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:15.990736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462be1-79b2-4176-b821-ba039b465a8e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:15.991698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 782/1577] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:15.992475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.048800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.049416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.049693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.049968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.050616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.052624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.058796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832c615-809a-4508-8df7-48b4191bddde admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.064394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.065023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.065304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.065573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.066201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.068226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.080217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:16.085384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 796/1578] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:16.085384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.094616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 783/1579] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:15 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:16.095857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.106149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91bdcd-69e1-429c-8684-7ad18920f206 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.152391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e93e-9c99-4c73-91c7-2f769492a9eb admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.157046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.157663 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.157938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.158206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.158827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.160796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.165402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.166188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.166305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.166572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.167313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.169279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.185585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:16.192628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 784/1580] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:16.193611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.200598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 797/1581] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:16.200598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.205453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326f05-3689-4b6f-bde3-11e7c12a6c4e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.266425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66144-da92-4785-abd2-125d8431b4bf admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.271050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.271607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.271720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.272069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.272226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.272349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.272653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.272901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.272995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.273563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.274559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.275207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.290519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 798/1582] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.291184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 785/1583] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.291302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.291411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.298930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a40238-c1ed-43af-8ae2-508e9c3f83ca admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.303917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabe578-dfff-4e8e-9a19-925467b501fd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.307763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.308388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.308598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.308755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.309027 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.309135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.309420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.309661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.309788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.310439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.311662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.312969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.335340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 799/1584] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/users => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:16.336120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.339614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 786/1585] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:16.339614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.346841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194780e-0ec6-44e2-96a7-a678c364fd3a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.349862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b48a70-37b2-4622-bc14-f9b8917808cc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.352001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.352641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.352925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.353197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.353837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.354947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.355620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.355833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.355951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.356165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.356814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.358405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.366967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 800/1586] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.367603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.371553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 787/1587] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.371553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.377503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb0fa7-fdb6-4fcd-ac8d-b1f1b42116a7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.381539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f27b7-624e-4025-a108-d79505190b52 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.382057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.382654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.382986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.383200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.383876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.385805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.386454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.387071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.387344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.387642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.388626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.390188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.401403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 788/1588] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.402490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.412619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb62346-b83e-4dce-9377-b0230eb25c47 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.418891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.419503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.420055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.420252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.423714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 801/1589] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:16.423849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.423962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.424054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.434986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 789/1590] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.435788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.435940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9327c7-a2ca-4596-b8da-cf5fb0ed1ed9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.442147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.442736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.443054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.443403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.444234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.446132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.448264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76abba4-89b5-4f6d-9ed8-9da61a686c50 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.453597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.454219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.454546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.454820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.455498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.457229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.461126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 802/1591] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.461126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.470884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 790/1592] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.470884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.471125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff2c97-3a6e-4891-a45f-d44f52b65cfc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.474183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.475366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.475366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.475366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.476050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.477674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.478638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba43979-669d-4d5c-bd85-3b1de198923d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.484577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.485215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.485495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.485766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.486382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.488019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.488695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 803/1593] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.489427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.499645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 791/1594] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.500579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.502515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c58d6-bbad-4674-b142-9b3dabcc1d6f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.507728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.508430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.508711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.508981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] PATH_INFO: `/v3/projects/28195d4019ba446aae085e89450249dc/users/8ca22f264fac474a808f6932217a265d/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.510738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e968-641a-4854-b772-f09345c638d7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.516927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.517538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.517815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.518124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.518730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.520387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.522622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:16.525643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28195d4019ba446aae085e89450249dc, user_id=8ca22f264fac474a808f6932217a265d, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.528592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.536664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 792/1595] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.537885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.543691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 804/1596] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:16 2022] PUT /identity/v3/projects/28195d4019ba446aae085e89450249dc/users/8ca22f264fac474a808f6932217a265d/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:16.548195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f4ab-547d-4ce8-aedf-4096b99953b1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.552728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.605067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.605637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.605912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.606187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] PATH_INFO: `/v3/projects/34f55d87942e48a6b2ae2b6fae12dbc5/users/32af613bff074efa8a8605709d3eb255/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.616749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19f731-6178-4283-a0df-d08ce360948f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.620737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f55d87942e48a6b2ae2b6fae12dbc5, user_id=32af613bff074efa8a8605709d3eb255, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.621780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:39:16.621780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:39:16.621780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:39:16.622643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.623270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.623549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.623752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.623879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.624511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.626161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.628576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:16.643256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 793/1597] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:16 2022] PUT /identity/v3/projects/34f55d87942e48a6b2ae2b6fae12dbc5/users/32af613bff074efa8a8605709d3eb255/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:16.643656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 805/1598] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.643781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.643872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.653431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94c6b7-0bc9-4e5c-867c-238283eb7dee admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.704763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ab73-51c9-4150-8817-0461d286ce2f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.709023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.709453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.709702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.710064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.710197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.710343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.710437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] PATH_INFO: `/v3/projects/356481e2fee64ff589b341f6a49f9550/users/b63bdc80864b45988e6682af949d6a7c/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.710618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.711265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.712922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.724699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 794/1599] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.725378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=356481e2fee64ff589b341f6a49f9550, user_id=b63bdc80864b45988e6682af949d6a7c, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.725591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.728145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.736542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99bc8c-7446-4344-bc62-e3db03654f60 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.741727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc0d2f-7ffb-4030-882a-6b45b5ce535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.742383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc0d2f-7ffb-4030-882a-6b45b5ce535d admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.742666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc0d2f-7ffb-4030-882a-6b45b5ce535d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.742940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc0d2f-7ffb-4030-882a-6b45b5ce535d admin admin] PATH_INFO: `/v3/projects/af89fd01e26943eeb101cfeaeca5bd38/users/a2c490a6ee594cb3826332dfa8eeb45a/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.744940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 806/1600] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:16 2022] PUT /identity/v3/projects/356481e2fee64ff589b341f6a49f9550/users/b63bdc80864b45988e6682af949d6a7c/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:16.746055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.759670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc0d2f-7ffb-4030-882a-6b45b5ce535d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af89fd01e26943eeb101cfeaeca5bd38, user_id=a2c490a6ee594cb3826332dfa8eeb45a, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.762798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc0d2f-7ffb-4030-882a-6b45b5ce535d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.778479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 795/1601] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:16 2022] PUT /identity/v3/projects/af89fd01e26943eeb101cfeaeca5bd38/users/a2c490a6ee594cb3826332dfa8eeb45a/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:16.783317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf387e3-df2b-406e-ba66-40b0c75cf584 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.783645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf387e3-df2b-406e-ba66-40b0c75cf584 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.783929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf387e3-df2b-406e-ba66-40b0c75cf584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.809241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d78749-4f24-4602-ae6e-695c23667f6d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.811783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9cf387e3-df2b-406e-ba66-40b0c75cf584 None None] MFA Rules not processed for user `8ca22f264fac474a808f6932217a265d`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:16.813285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9cf387e3-df2b-406e-ba66-40b0c75cf584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:16.863384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:16.874874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.875425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.875743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.876040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.876658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.878314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.889333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 807/1602] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:16.890350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.901164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 796/1603] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:16.901164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8857a-79bd-4fed-8154-b4b5e4fd5967 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.901164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8857a-79bd-4fed-8154-b4b5e4fd5967 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.901515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2fbdc-7c6a-48a7-bce4-d282499cd822 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.901628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8857a-79bd-4fed-8154-b4b5e4fd5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.905507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6d8b4-4217-45a3-a91e-6ff8c8204568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:16.906165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6d8b4-4217-45a3-a91e-6ff8c8204568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.906444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6d8b4-4217-45a3-a91e-6ff8c8204568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.906719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6d8b4-4217-45a3-a91e-6ff8c8204568 admin admin] PATH_INFO: `/v3/projects/4396563bbfda45acb65cb84456eb901b/users/dd4031300b4a44c593b860af615a14c4/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.922113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-edc8857a-79bd-4fed-8154-b4b5e4fd5967 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:16.923317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-edc8857a-79bd-4fed-8154-b4b5e4fd5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:16.923429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6d8b4-4217-45a3-a91e-6ff8c8204568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4396563bbfda45acb65cb84456eb901b, user_id=dd4031300b4a44c593b860af615a14c4, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:16.926091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6d8b4-4217-45a3-a91e-6ff8c8204568 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:16.931832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 797/1604] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:16.932555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8857a-79bd-4fed-8154-b4b5e4fd5967 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:16.939758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:16.943391 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8857a-79bd-4fed-8154-b4b5e4fd5967 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:16.945582 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 808/1605] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:16 2022] PUT /identity/v3/projects/4396563bbfda45acb65cb84456eb901b/users/dd4031300b4a44c593b860af615a14c4/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:16.946869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf70a2-2787-436a-b83c-9e88a4293fec None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:16.947155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf70a2-2787-436a-b83c-9e88a4293fec None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:16.947431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf70a2-2787-436a-b83c-9e88a4293fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:16.989356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0abf70a2-2787-436a-b83c-9e88a4293fec None None] MFA Rules not processed for user `b63bdc80864b45988e6682af949d6a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:16.990686 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0abf70a2-2787-436a-b83c-9e88a4293fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.020993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7dbb0-7b00-42f3-ac65-94ac40fdb0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.021643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7dbb0-7b00-42f3-ac65-94ac40fdb0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.021938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7dbb0-7b00-42f3-ac65-94ac40fdb0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.022222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7dbb0-7b00-42f3-ac65-94ac40fdb0e0 admin admin] PATH_INFO: `/v3/projects/82675a2298424f038ca2cc43f2df1f1a/users/17fdb3fb9bb04c21ba95096f1bd6e6ee/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.037599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7dbb0-7b00-42f3-ac65-94ac40fdb0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82675a2298424f038ca2cc43f2df1f1a, user_id=17fdb3fb9bb04c21ba95096f1bd6e6ee, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.041133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7dbb0-7b00-42f3-ac65-94ac40fdb0e0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.056496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 798/1606] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:16 2022] PUT /identity/v3/projects/82675a2298424f038ca2cc43f2df1f1a/users/17fdb3fb9bb04c21ba95096f1bd6e6ee/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:17.057991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ccc33-39cd-4e8d-8c6b-1a8d32870ce4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.058264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ccc33-39cd-4e8d-8c6b-1a8d32870ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.058533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ccc33-39cd-4e8d-8c6b-1a8d32870ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.066056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 809/1607] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:17.067115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf70a2-2787-436a-b83c-9e88a4293fec None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.077776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf70a2-2787-436a-b83c-9e88a4293fec None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.081350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d83ccc33-39cd-4e8d-8c6b-1a8d32870ce4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:17.082560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d83ccc33-39cd-4e8d-8c6b-1a8d32870ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.141632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.142894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.143023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.143404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] PATH_INFO: `/v3/projects/3cb6650a40b34d269721499ede1945e9/users/56d10c0652da49bf8f41f467ca25c6ce/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.144268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 799/1608] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:17.148792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ccc33-39cd-4e8d-8c6b-1a8d32870ce4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.159174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ccc33-39cd-4e8d-8c6b-1a8d32870ce4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.164220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb6650a40b34d269721499ede1945e9, user_id=56d10c0652da49bf8f41f467ca25c6ce, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.164393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc96c7e-105d-454c-aa38-164c55f6e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.164929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96c7e-105d-454c-aa38-164c55f6e4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.165218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96c7e-105d-454c-aa38-164c55f6e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.165498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96c7e-105d-454c-aa38-164c55f6e4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.166135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc96c7e-105d-454c-aa38-164c55f6e4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.166903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.168918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc96c7e-105d-454c-aa38-164c55f6e4a5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.182261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 810/1609] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:17 2022] PUT /identity/v3/projects/3cb6650a40b34d269721499ede1945e9/users/56d10c0652da49bf8f41f467ca25c6ce/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:17.183260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.184950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.208133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 800/1610] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:17.209405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d806-ee66-4033-be18-20216fbfd691 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.209693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d806-ee66-4033-be18-20216fbfd691 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.210077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d806-ee66-4033-be18-20216fbfd691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.238144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2df2d806-ee66-4033-be18-20216fbfd691 None None] MFA Rules not processed for user `dd4031300b4a44c593b860af615a14c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:17.239406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2df2d806-ee66-4033-be18-20216fbfd691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.244164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3627eea-0471-45dc-b7e5-a0216d842367 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.267867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:17.273186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:17.298735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.299436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.299771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.299895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.314355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 801/1611] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:17.316390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ab95-5024-4027-b8b8-fc1147e6924a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.316714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ab95-5024-4027-b8b8-fc1147e6924a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.316993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485ab95-5024-4027-b8b8-fc1147e6924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.335962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7485ab95-5024-4027-b8b8-fc1147e6924a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:17.337173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7485ab95-5024-4027-b8b8-fc1147e6924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.364187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.365740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.377110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 811/1612] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:17.378066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.388403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e25be5-a965-42e1-a83d-44acb63a55eb service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.394551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc0623-7655-4e14-bc8b-06eca3373bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.395097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc0623-7655-4e14-bc8b-06eca3373bee admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.395370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc0623-7655-4e14-bc8b-06eca3373bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.395670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc0623-7655-4e14-bc8b-06eca3373bee admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.396293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc0623-7655-4e14-bc8b-06eca3373bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.398353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc0623-7655-4e14-bc8b-06eca3373bee admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.407566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 802/1613] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:17.408987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b68b4-7bf1-4976-b040-43f8a8cd22e0 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.409274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b68b4-7bf1-4976-b040-43f8a8cd22e0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.409549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b68b4-7bf1-4976-b040-43f8a8cd22e0 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.411291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 803/1614] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 16:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:17.411764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b68b4-7bf1-4976-b040-43f8a8cd22e0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.423803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b68b4-7bf1-4976-b040-43f8a8cd22e0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.427626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.428244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.428575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.428856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.439105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.440589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.441440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 812/1615] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:17.443450 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3587-c6e0-484b-8631-61197f1ec15b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.443902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3587-c6e0-484b-8631-61197f1ec15b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.444212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a3587-c6e0-484b-8631-61197f1ec15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.452615 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 804/1616] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:17.453424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.463474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301574d-2285-4c73-bd26-940a75ca21ba service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.478233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7c9a3587-c6e0-484b-8631-61197f1ec15b None None] MFA Rules not processed for user `56d10c0652da49bf8f41f467ca25c6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:17.479850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7c9a3587-c6e0-484b-8631-61197f1ec15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.539934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dce4ca-0ea5-4fd8-b2e6-a71060a9b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.540568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce4ca-0ea5-4fd8-b2e6-a71060a9b9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.540849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce4ca-0ea5-4fd8-b2e6-a71060a9b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.541118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce4ca-0ea5-4fd8-b2e6-a71060a9b9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.541749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dce4ca-0ea5-4fd8-b2e6-a71060a9b9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.544667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dce4ca-0ea5-4fd8-b2e6-a71060a9b9f0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.565587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 813/1617] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:17.566599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a3587-c6e0-484b-8631-61197f1ec15b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.569006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 805/1618] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:17.570160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7109c-f767-4de2-a909-19db8673b87e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.570435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7109c-f767-4de2-a909-19db8673b87e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.570797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7109c-f767-4de2-a909-19db8673b87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.593167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a3587-c6e0-484b-8631-61197f1ec15b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.609348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.610130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.611040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.611464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.613419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.616266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.626607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-04b7109c-f767-4de2-a909-19db8673b87e None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:17.628461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-04b7109c-f767-4de2-a909-19db8673b87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.656300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 814/1619] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/projects => generated 403 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:17.656300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.665591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:17.688836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:17.721893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f4f95-b0a9-4096-85cf-2b5135b10daa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.725981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.726870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.727150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.727688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.727805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 806/1620] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:17.728724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7109c-f767-4de2-a909-19db8673b87e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.741583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7109c-f767-4de2-a909-19db8673b87e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.803183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.804708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.814049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561159d0-2c44-4072-9626-94f8bde294cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.815231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561159d0-2c44-4072-9626-94f8bde294cb admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.815696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561159d0-2c44-4072-9626-94f8bde294cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.816095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561159d0-2c44-4072-9626-94f8bde294cb admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.816736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561159d0-2c44-4072-9626-94f8bde294cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.819317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561159d0-2c44-4072-9626-94f8bde294cb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.825854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 815/1621] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:17.826840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.846129 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb5e5-7c7b-44dd-89a3-c00ceaceffbf service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.854272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 807/1622] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:17.854272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0872-85ba-40c7-b731-a50e79532d97 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.854272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0872-85ba-40c7-b731-a50e79532d97 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.854272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0872-85ba-40c7-b731-a50e79532d97 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.855405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 808/1623] 10.222.0.88 () {54 vars in 962 bytes} [Wed Aug 24 16:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:17.856374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0872-85ba-40c7-b731-a50e79532d97 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.864612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d31397-5848-4166-b843-7db3fc68bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.865479 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31397-5848-4166-b843-7db3fc68bf0b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.866111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31397-5848-4166-b843-7db3fc68bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.866506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31397-5848-4166-b843-7db3fc68bf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.867513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d31397-5848-4166-b843-7db3fc68bf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.869422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d31397-5848-4166-b843-7db3fc68bf0b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.871914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0872-85ba-40c7-b731-a50e79532d97 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.878454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a2562-5616-4673-9e54-4126a8741530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.879305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2562-5616-4673-9e54-4126a8741530 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.879869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2562-5616-4673-9e54-4126a8741530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.880261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2562-5616-4673-9e54-4126a8741530 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.881035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a2562-5616-4673-9e54-4126a8741530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.886815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a2562-5616-4673-9e54-4126a8741530 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.887009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 816/1624] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:17.889085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305dbd0-5372-4bc8-84d9-c739cd4f401d None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.889374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305dbd0-5372-4bc8-84d9-c739cd4f401d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.889649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305dbd0-5372-4bc8-84d9-c739cd4f401d None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.892688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 817/1625] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 16:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:17.893579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305dbd0-5372-4bc8-84d9-c739cd4f401d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.909935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305dbd0-5372-4bc8-84d9-c739cd4f401d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.915614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.916306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.916593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.917293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.918533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.920804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:17.926483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 809/1626] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/users => generated 308 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:17.928546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254895da-dac1-41a1-866b-aba81f32ea87 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.929952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254895da-dac1-41a1-866b-aba81f32ea87 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.930611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254895da-dac1-41a1-866b-aba81f32ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.940033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 818/1627] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:17.941018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:17.954606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9217c-e724-42d3-bc45-a14456d1350b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:17.960522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90012f-54a8-4b07-91d2-91ac7f874355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:17.961376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90012f-54a8-4b07-91d2-91ac7f874355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:17.962173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90012f-54a8-4b07-91d2-91ac7f874355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:17.962460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90012f-54a8-4b07-91d2-91ac7f874355 admin admin] PATH_INFO: `/v3/projects/54628fbdcb4c4aeeb2a97568ce667a9c/users/b2dd44e93e9940328407f36e57f167b0/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:17.969626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-254895da-dac1-41a1-866b-aba81f32ea87 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:17.971382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-254895da-dac1-41a1-866b-aba81f32ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:17.987307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90012f-54a8-4b07-91d2-91ac7f874355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54628fbdcb4c4aeeb2a97568ce667a9c, user_id=b2dd44e93e9940328407f36e57f167b0, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:17.996032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90012f-54a8-4b07-91d2-91ac7f874355 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.023616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 819/1628] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:17 2022] PUT /identity/v3/projects/54628fbdcb4c4aeeb2a97568ce667a9c/users/b2dd44e93e9940328407f36e57f167b0/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:18.026167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ba23-8b97-4d5e-852f-35cc8892651e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.026386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ba23-8b97-4d5e-852f-35cc8892651e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.026920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413ba23-8b97-4d5e-852f-35cc8892651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.057315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a413ba23-8b97-4d5e-852f-35cc8892651e None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:18.059377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a413ba23-8b97-4d5e-852f-35cc8892651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:18.089830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 810/1629] 10.222.0.88 () {58 vars in 1059 bytes} [Wed Aug 24 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:18.091182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254895da-dac1-41a1-866b-aba81f32ea87 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.102986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254895da-dac1-41a1-866b-aba81f32ea87 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.164784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 820/1630] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:39:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:18.165477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:18.166295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413ba23-8b97-4d5e-852f-35cc8892651e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.198599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:18.217798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.218964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.218964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.219182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.219825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.221720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.237757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 811/1631] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:18.238773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.258690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3745099-3e5d-4ec5-a895-c35017252a04 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.264491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.265130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.265453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.265732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.266382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.267377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413ba23-8b97-4d5e-852f-35cc8892651e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.268106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.274814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.277550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.277893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.278282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] PATH_INFO: `/v3/projects/a1cf1511bd594217baeb367680063484/users/6e9ca6daa9bb48c2bac7a804e92ebf5c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.280398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 812/1632] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:18.280398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.310764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf8f49-201f-407a-a21f-29ae2cc2f012 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.312273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cf1511bd594217baeb367680063484, user_id=6e9ca6daa9bb48c2bac7a804e92ebf5c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.315195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.327083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.327958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.328252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.328509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.337882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 821/1633] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:18 2022] PUT /identity/v3/projects/a1cf1511bd594217baeb367680063484/users/6e9ca6daa9bb48c2bac7a804e92ebf5c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:18.339335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.446422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc07d9b-bbf7-4331-b5ef-c4449963c18a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.452411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.453200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.453482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.453770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.456311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.458005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.480911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 813/1634] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:18.481893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.504398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04ee6-af50-4d27-b3d8-0d6a7f497bbc service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.573655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.578154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.596148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 822/1635] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:18.597548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.640796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.642320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.642865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.643362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] PATH_INFO: `/v3/projects/e65dd09ddc4e480ebc0ce4fa05fdae17/users/e491500a7bce41679509fa49ad58ea9a/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.678896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65dd09ddc4e480ebc0ce4fa05fdae17, user_id=e491500a7bce41679509fa49ad58ea9a, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.683969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.722629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 814/1636] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:18 2022] PUT /identity/v3/projects/e65dd09ddc4e480ebc0ce4fa05fdae17/users/e491500a7bce41679509fa49ad58ea9a/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:18.723729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.744063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:18.784245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f84c7-5df1-45e1-b260-830b4a2b9ea6 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.821099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:18.876231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe617de-0916-4281-8305-40affc826184 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.882311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.883904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.884305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.884715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.885474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.888753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.892890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.895078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.895762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.898933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] PATH_INFO: `/v3/projects/54628fbdcb4c4aeeb2a97568ce667a9c/users/b2dd44e93e9940328407f36e57f167b0/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.903715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 815/1637] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:18.904706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54628fbdcb4c4aeeb2a97568ce667a9c, user_id=b2dd44e93e9940328407f36e57f167b0, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.904868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.915972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.918962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717cc7f-420e-43bb-87ad-7ea6c9eccf4c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:18.926490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2076f72-24b1-44f5-a9dc-e1085c498e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:18.927545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076f72-24b1-44f5-a9dc-e1085c498e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.928023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076f72-24b1-44f5-a9dc-e1085c498e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.928591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2076f72-24b1-44f5-a9dc-e1085c498e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:18.930463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2076f72-24b1-44f5-a9dc-e1085c498e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:18.932754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2076f72-24b1-44f5-a9dc-e1085c498e5b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:18.943865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 823/1638] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:18 2022] PUT /identity/v3/projects/54628fbdcb4c4aeeb2a97568ce667a9c/users/b2dd44e93e9940328407f36e57f167b0/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:18.945436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:18.957979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 816/1639] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:18.960868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2be7d-8b1b-4852-89ac-60be51b18115 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:18.961829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2be7d-8b1b-4852-89ac-60be51b18115 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:18.962113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2be7d-8b1b-4852-89ac-60be51b18115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.038535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b0a2be7d-8b1b-4852-89ac-60be51b18115 None None] MFA Rules not processed for user `b2dd44e93e9940328407f36e57f167b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:19.040711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b0a2be7d-8b1b-4852-89ac-60be51b18115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:19.108452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50879ce2-172f-4d7b-8b6a-b69853262590 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:19.121195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:19.123692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.124024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.126279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] PATH_INFO: `/v3/projects/a1cf1511bd594217baeb367680063484/users/6e9ca6daa9bb48c2bac7a804e92ebf5c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.131257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cf1511bd594217baeb367680063484, user_id=6e9ca6daa9bb48c2bac7a804e92ebf5c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:19.137586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:19.166661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 824/1640] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:18 2022] PUT /identity/v3/projects/a1cf1511bd594217baeb367680063484/users/6e9ca6daa9bb48c2bac7a804e92ebf5c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:19.169598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:19.228665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 817/1641] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:19.230270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b6f2-da16-4cbf-8e17-295bf4fdba8d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.230740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b6f2-da16-4cbf-8e17-295bf4fdba8d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.231247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b6f2-da16-4cbf-8e17-295bf4fdba8d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.237481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 818/1642] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 16:39:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:19.238787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693a23-4bd1-40cc-9ec8-aec8b989d625 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.239079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693a23-4bd1-40cc-9ec8-aec8b989d625 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.239374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8693a23-4bd1-40cc-9ec8-aec8b989d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.311919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d8693a23-4bd1-40cc-9ec8-aec8b989d625 None None] MFA Rules not processed for user `6e9ca6daa9bb48c2bac7a804e92ebf5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:19.314357 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d8693a23-4bd1-40cc-9ec8-aec8b989d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:19.345301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a1a83-bcb1-44e3-a747-3a4f36dab694 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:19.365561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5481a4-2255-46e6-8a62-675e8f4d47ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:19.366259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5481a4-2255-46e6-8a62-675e8f4d47ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.366624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5481a4-2255-46e6-8a62-675e8f4d47ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.366910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5481a4-2255-46e6-8a62-675e8f4d47ca admin admin] PATH_INFO: `/v3/projects/e65dd09ddc4e480ebc0ce4fa05fdae17/users/e491500a7bce41679509fa49ad58ea9a/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.369046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5481a4-2255-46e6-8a62-675e8f4d47ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65dd09ddc4e480ebc0ce4fa05fdae17, user_id=e491500a7bce41679509fa49ad58ea9a, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:19.375516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5481a4-2255-46e6-8a62-675e8f4d47ca admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:19.406920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 825/1643] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:19 2022] PUT /identity/v3/projects/e65dd09ddc4e480ebc0ce4fa05fdae17/users/e491500a7bce41679509fa49ad58ea9a/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:19.407442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020446e-d007-446f-a10d-00d1a464976e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.407761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020446e-d007-446f-a10d-00d1a464976e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.408032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020446e-d007-446f-a10d-00d1a464976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.416440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 819/1644] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:19.418921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693a23-4bd1-40cc-9ec8-aec8b989d625 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:19.466748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8020446e-d007-446f-a10d-00d1a464976e None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:19.469357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8020446e-d007-446f-a10d-00d1a464976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:19.487286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:19.494845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:19.545374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8693a23-4bd1-40cc-9ec8-aec8b989d625 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:19.618670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:19.619789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.620533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.621120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.631656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 826/1645] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:39:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:19.633066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13bfa8-95b4-4805-bf8e-ca937a960da2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.633354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13bfa8-95b4-4805-bf8e-ca937a960da2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.633630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13bfa8-95b4-4805-bf8e-ca937a960da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.694404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fa13bfa8-95b4-4805-bf8e-ca937a960da2 None None] MFA Rules not processed for user `e491500a7bce41679509fa49ad58ea9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:19.696110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa13bfa8-95b4-4805-bf8e-ca937a960da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:19.711433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:19.716179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:19.733007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 820/1646] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:19.734544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:19.749833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3acf2-56d5-41aa-a09f-6a62946b7644 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:19.758403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:19.759305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.760569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.761122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.851884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 827/1647] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:19.852888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13bfa8-95b4-4805-bf8e-ca937a960da2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:19.873159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13bfa8-95b4-4805-bf8e-ca937a960da2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:19.873687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:19.875537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:19.877446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:19.878244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:19.878536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:19.878810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:19.893872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 821/1648] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:19.908788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:19.910331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:19.931445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 828/1649] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:20.584994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:20.597551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee2625-0c36-4461-8922-51607cb47a2b service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:20.605960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:20.606589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:20.606871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:20.607145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:20.628502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:20.632629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:20.666323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 822/1650] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:20.849233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:20.862693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae913d-147b-4e38-b174-58d7cc7d8281 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:20.872708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d71c74-6e42-43bc-ac9e-d819ccf15925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:20.872708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71c74-6e42-43bc-ac9e-d819ccf15925 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:20.873048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71c74-6e42-43bc-ac9e-d819ccf15925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:20.873048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d71c74-6e42-43bc-ac9e-d819ccf15925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:20.969734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d71c74-6e42-43bc-ac9e-d819ccf15925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:20.971839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d71c74-6e42-43bc-ac9e-d819ccf15925 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:20.997970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 829/1651] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:21.732229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:21.817415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:21.958721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4990895-1e36-4688-8391-2f61acb29bbb service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:21.973977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:21.974899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:21.975328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:21.975799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] PATH_INFO: `/v3/users/dd4031300b4a44c593b860af615a14c4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:21.978689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4031300b4a44c593b860af615a14c4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:21.981706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: WARNING py.warnings [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:39:21.981706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: warnings.warn(msg) Aug 24 16:39:21.981706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: Aug 24 16:39:21.997110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:22.186013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4031300b4a44c593b860af615a14c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.222354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4031300b4a44c593b860af615a14c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.315433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4031300b4a44c593b860af615a14c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.335086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4031300b4a44c593b860af615a14c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.336445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4031300b4a44c593b860af615a14c4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.348870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 823/1652] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:21 2022] DELETE /identity/v3/users/dd4031300b4a44c593b860af615a14c4 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:22.350375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:22.351181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:22.351606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:22.404631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:22.410241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:22.441543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:22.685300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 830/1653] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:22.708518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:22.712097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:22.768854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:22.772363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:22.802612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb4bfe-999f-474a-9b56-29866990424a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:22.818173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:22.818960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:22.819323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:22.820733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] PATH_INFO: `/v3/users/56d10c0652da49bf8f41f467ca25c6ce` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:22.822888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d10c0652da49bf8f41f467ca25c6ce)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:22.827144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:22.888616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cde9ea-74bd-4f40-a1ef-c61ed4cc9d6c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:22.897504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:22.900100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:22.900382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:22.900678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:22.937086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:22.941209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:22.947648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d10c0652da49bf8f41f467ca25c6ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.948637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d10c0652da49bf8f41f467ca25c6ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.965286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d10c0652da49bf8f41f467ca25c6ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.970546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d10c0652da49bf8f41f467ca25c6ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:22.975367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 824/1654] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:22.978218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:22.983530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:22.996875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49c343f9-8327-4792-8de4-dba62f786a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d10c0652da49bf8f41f467ca25c6ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:23.036226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 831/1655] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:22 2022] DELETE /identity/v3/users/56d10c0652da49bf8f41f467ca25c6ce => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:23.048328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:23.048615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:23.048887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:23.120244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:23.124281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:23.135139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:23.174982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788c7ab-144e-430c-b3a6-7b4f016cbe70 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:23.323731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 832/1656] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:23.330015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:23.330635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:23.330909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:23.331302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:23.333986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:23.355059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:23.362698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:23.409725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:23.451003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987a3ab-12e6-4df8-8fa1-d4133639120d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:23.458023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:23.459898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:23.462223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:23.462912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:23.463188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:23.463457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:23.482096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 825/1657] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:23.493829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:23.495673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:23.510467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 833/1658] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:25.062538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:25.064104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:25.092637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d73e0-ddac-43cd-960c-d14766e50ce9 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:25.098623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:25.099723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:25.107714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:25.108203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] PATH_INFO: `/v3/projects/4396563bbfda45acb65cb84456eb901b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:25.110663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4396563bbfda45acb65cb84456eb901b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:25.113947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:25.207503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4396563bbfda45acb65cb84456eb901b', 'request_id': 'req-94638d3e-110f-49c8-a086-5e8c76659bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.232527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4396563bbfda45acb65cb84456eb901b', 'request_id': 'req-94638d3e-110f-49c8-a086-5e8c76659bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.250915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4396563bbfda45acb65cb84456eb901b', 'request_id': 'req-94638d3e-110f-49c8-a086-5e8c76659bfd'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.282287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] The token cache is being invalidate because project 4396563bbfda45acb65cb84456eb901b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:25.283109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.287109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.294426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 826/1659] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:25 2022] DELETE /identity/v3/projects/4396563bbfda45acb65cb84456eb901b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:25.298005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:25.342896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef321134-b446-41b2-9d82-62b020f4737d service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:25.530189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:25.531079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:25.531204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:25.531399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] PATH_INFO: `/v3/users/e491500a7bce41679509fa49ad58ea9a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:25.536607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e491500a7bce41679509fa49ad58ea9a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:25.543477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:25.737589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e491500a7bce41679509fa49ad58ea9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.739124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e491500a7bce41679509fa49ad58ea9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.768585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e491500a7bce41679509fa49ad58ea9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.770599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e491500a7bce41679509fa49ad58ea9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.793737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-45c73e40-a811-49ad-a66e-e1e1908d64e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e491500a7bce41679509fa49ad58ea9a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:25.853929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 834/1660] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:25 2022] DELETE /identity/v3/users/e491500a7bce41679509fa49ad58ea9a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:26.229170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:26.231318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:26.295438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94638d3e-110f-49c8-a086-5e8c76659bfd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:26.395923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:26.492447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:26.492447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:26.492447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:26.492447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] PATH_INFO: `/v3/projects/3cb6650a40b34d269721499ede1945e9` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:26.495000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb6650a40b34d269721499ede1945e9)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:26.498836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:26.637477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb6650a40b34d269721499ede1945e9', 'request_id': 'req-f2606758-c4e5-4de0-a59e-f0f691adec20'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:26.667983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb6650a40b34d269721499ede1945e9', 'request_id': 'req-f2606758-c4e5-4de0-a59e-f0f691adec20'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:26.694026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb6650a40b34d269721499ede1945e9', 'request_id': 'req-f2606758-c4e5-4de0-a59e-f0f691adec20'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:26.734113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] The token cache is being invalidate because project 3cb6650a40b34d269721499ede1945e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:26.735472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:26.736968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f2606758-c4e5-4de0-a59e-f0f691adec20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:26.742291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 827/1661] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:26 2022] DELETE /identity/v3/projects/3cb6650a40b34d269721499ede1945e9 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:26.749249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb413ac-9ca2-4ea6-99e7-36d6fce3f527 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:26.751319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb413ac-9ca2-4ea6-99e7-36d6fce3f527 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:26.752372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb413ac-9ca2-4ea6-99e7-36d6fce3f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:26.811236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6eb413ac-9ca2-4ea6-99e7-36d6fce3f527 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:26.816136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6eb413ac-9ca2-4ea6-99e7-36d6fce3f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:26.985108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:27.039611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493d32b-621a-440e-b3aa-5ccf52cdfa30 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.040197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493d32b-621a-440e-b3aa-5ccf52cdfa30 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.040197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493d32b-621a-440e-b3aa-5ccf52cdfa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.049464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 835/1662] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:39:27.068028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d493d32b-621a-440e-b3aa-5ccf52cdfa30 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:27.069598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d493d32b-621a-440e-b3aa-5ccf52cdfa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:27.138625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb413ac-9ca2-4ea6-99e7-36d6fce3f527 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:27.149230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 828/1663] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:27.160024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb413ac-9ca2-4ea6-99e7-36d6fce3f527 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:27.173739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:27.174648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.175120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.175791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.176615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:27.177315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:27.181057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:27.224611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 836/1664] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:27.229838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493d32b-621a-440e-b3aa-5ccf52cdfa30 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:27.241777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493d32b-621a-440e-b3aa-5ccf52cdfa30 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:27.256749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:27.257729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.258285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.258851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.260169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:27.265802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:27.344935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 829/1665] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:27 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:27.349325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:27.367064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0806-627a-4ef2-8444-52835caa71ef admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:27.545825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:27.546386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.546668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.546949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.547702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:27.550581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:27.592912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 837/1666] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:27 2022] POST /identity/v3/users => generated 302 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:27.597103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:27.620910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213350-acaa-4bb9-aceb-30bf919b39dd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:27.628623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:27.629287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.641997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.645991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.646987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:27.652417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:27.687437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 830/1667] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:39:27.688745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:27.705643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c65d-79b5-4ecc-a6c0-8beedb4ed9dc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:27.713714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388e02a-9067-4fb1-a389-6e728928cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:27.715264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e02a-9067-4fb1-a389-6e728928cafa admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.715896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e02a-9067-4fb1-a389-6e728928cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.716359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388e02a-9067-4fb1-a389-6e728928cafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.717374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388e02a-9067-4fb1-a389-6e728928cafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:27.719501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388e02a-9067-4fb1-a389-6e728928cafa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:27.763017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 838/1668] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:27.765194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:27.781121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf00e3-20bb-477c-b356-07246750c8c4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:27.794904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:27.796241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.796241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.797461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] PATH_INFO: `/v3/projects/e56ac2a6467541baa4dfc801075cafce/users/22bc4649e5af4816b222c1097e034c54/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.829168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56ac2a6467541baa4dfc801075cafce, user_id=22bc4649e5af4816b222c1097e034c54, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:27.841862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:27.875258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 831/1669] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:27 2022] PUT /identity/v3/projects/e56ac2a6467541baa4dfc801075cafce/users/22bc4649e5af4816b222c1097e034c54/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:39:27.896384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:27.896839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:27.897127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:27.956847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:27.958375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:28.091868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 839/1670] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:28.132552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:28.135788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:28.203493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:28.207526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:28.227478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132402d-646b-436b-afa7-c881fbbee01b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:28.245043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:28.245794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:28.246071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:28.246341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] PATH_INFO: `/v3/projects/e65dd09ddc4e480ebc0ce4fa05fdae17` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:28.247932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65dd09ddc4e480ebc0ce4fa05fdae17)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:28.250745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: WARNING py.warnings [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 16:39:28.250745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: warnings.warn(msg) Aug 24 16:39:28.250745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: Aug 24 16:39:28.253783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:28.383042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186abf3-9f17-48ac-9c3b-f17ce88496fe admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:28.406099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65dd09ddc4e480ebc0ce4fa05fdae17', 'request_id': 'req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:28.411695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:28.422853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65dd09ddc4e480ebc0ce4fa05fdae17', 'request_id': 'req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:28.423882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:28.461999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65dd09ddc4e480ebc0ce4fa05fdae17', 'request_id': 'req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:28.501257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] The token cache is being invalidate because project e65dd09ddc4e480ebc0ce4fa05fdae17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:28.503084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:28.504097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0b92a8d7-7ebf-40c2-a830-b5649b427a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:28.508723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 840/1671] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:28 2022] DELETE /identity/v3/projects/e65dd09ddc4e480ebc0ce4fa05fdae17 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:28.555996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d425e-d710-4baf-a54f-859ba71632d5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:28.559887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d425e-d710-4baf-a54f-859ba71632d5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:28.560386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d425e-d710-4baf-a54f-859ba71632d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:28.566475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b8043-2840-4c8e-b585-2608dfd96e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:28.567288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8043-2840-4c8e-b585-2608dfd96e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:28.567421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8043-2840-4c8e-b585-2608dfd96e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:28.567697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8043-2840-4c8e-b585-2608dfd96e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:28.575686 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-028b8043-2840-4c8e-b585-2608dfd96e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:28.696149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3a1d425e-d710-4baf-a54f-859ba71632d5 None None] MFA Rules not processed for user `a2c490a6ee594cb3826332dfa8eeb45a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:28.704451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3a1d425e-d710-4baf-a54f-859ba71632d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:28.739406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b8043-2840-4c8e-b585-2608dfd96e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:28.740943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b8043-2840-4c8e-b585-2608dfd96e00 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:28.760865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 832/1672] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:28.762213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:28.762494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:28.762762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:28.804254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:28.806133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:28.839029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 833/1673] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:28.839029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:28.841055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:28.867684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e411eb-3e02-4db9-b866-5f3beb724901 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:28.880718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:28.880718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:28.880718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:28.881135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] PATH_INFO: `/v3/users/b63bdc80864b45988e6682af949d6a7c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:28.883517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63bdc80864b45988e6682af949d6a7c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:28.894238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:28.947317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 841/1674] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:28.949537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:28.950023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:28.950334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.008607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:29.011740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:29.032839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63bdc80864b45988e6682af949d6a7c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:29.036302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 842/1675] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:29.039997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:29.045943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:29.052949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63bdc80864b45988e6682af949d6a7c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:29.097898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63bdc80864b45988e6682af949d6a7c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:29.120576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63bdc80864b45988e6682af949d6a7c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:29.121748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63bdc80864b45988e6682af949d6a7c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:29.133660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 834/1676] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:28 2022] DELETE /identity/v3/users/b63bdc80864b45988e6682af949d6a7c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:29.133660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:29.137465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:29.252986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:29.255353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f069cf-0825-4bd4-a165-fb091ab56602 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:29.299360 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b564-1d8e-4399-adf1-710306353a76 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:29.316540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e7510-0576-4e77-b1fb-e7fecfe582d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:29.317918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e7510-0576-4e77-b1fb-e7fecfe582d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:29.318431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e7510-0576-4e77-b1fb-e7fecfe582d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:29.319052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e7510-0576-4e77-b1fb-e7fecfe582d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.320255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e7510-0576-4e77-b1fb-e7fecfe582d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:29.320950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e7510-0576-4e77-b1fb-e7fecfe582d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:29.323035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e7510-0576-4e77-b1fb-e7fecfe582d2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:29.340317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 835/1677] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:29.342648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76135-1eb7-47bd-86ef-5e824c55ceba None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:29.343065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76135-1eb7-47bd-86ef-5e824c55ceba None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:29.343482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76135-1eb7-47bd-86ef-5e824c55ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.376389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b3d76135-1eb7-47bd-86ef-5e824c55ceba None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:29.379501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b3d76135-1eb7-47bd-86ef-5e824c55ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:29.389452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 836/1678] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:29.391013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76135-1eb7-47bd-86ef-5e824c55ceba None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:29.398381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:29.407830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76135-1eb7-47bd-86ef-5e824c55ceba None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:29.417378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:29.418803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:29.419270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:29.419766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.420764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:29.423020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:29.435506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:29.436341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:29.436622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:29.438044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.443302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:29.462760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 837/1679] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:29 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:29.463967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:29.467679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:29.550933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ab61b-37bf-48e5-b912-23884a43dba2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:29.555596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:29.556538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:29.557528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:29.558168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.587338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:29.589529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:29.603219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 843/1680] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:29.614953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:29.641845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbccb-3856-4c76-90a2-09c2f696cc38 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:29.700602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:29.706804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:29.734512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 838/1681] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:29.828330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:29.828965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:29.829265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:29.832370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.834514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:29.839668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:29.909250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 844/1682] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:29 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:29.913033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:29.931212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759beac3-8b37-453f-bf5b-1b7b7e63da79 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:29.956365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:29.957053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:29.957279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:29.957551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:29.958208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:29.960029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:29.993004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:29.996597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:30.018768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 839/1683] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:30.020066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:30.032539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c52a4-d89f-4c32-baf1-984f2261e131 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:30.036248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436d33d-30af-4028-a2ec-818f4cea8092 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:30.044351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:30.046814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:30.047136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:30.050404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] PATH_INFO: `/v3/users/6174776adacc42afbbf86d3be4ea747c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:30.051296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:30.052134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:30.052582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:30.053089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:30.053812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:30.058378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:30.061849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6174776adacc42afbbf86d3be4ea747c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:30.067749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:30.110521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 840/1684] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:30.114639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:30.147297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db883a85-09c8-472d-a5b3-1d7cb1b5fe0d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:30.163549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:30.164774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:30.164774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:30.164934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] PATH_INFO: `/v3/projects/005b7d89290241aaa7d7dde88ac70008/users/d959ac9f614a432b98f2b939a6fecbaf/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:30.204832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] RBAC: Authorizing `identity:create_grant(project_id=005b7d89290241aaa7d7dde88ac70008, user_id=d959ac9f614a432b98f2b939a6fecbaf, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:30.216473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:30.224971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6174776adacc42afbbf86d3be4ea747c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.227059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6174776adacc42afbbf86d3be4ea747c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.240745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:30.253535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6174776adacc42afbbf86d3be4ea747c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.255337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6174776adacc42afbbf86d3be4ea747c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.275028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 841/1685] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:30 2022] PUT /identity/v3/projects/005b7d89290241aaa7d7dde88ac70008/users/d959ac9f614a432b98f2b939a6fecbaf/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:30.276538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:30.280594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:30.295215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d2d5153-6050-468f-8c36-8dbebb6058e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6174776adacc42afbbf86d3be4ea747c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.328953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:30.341719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 845/1686] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:29 2022] DELETE /identity/v3/users/6174776adacc42afbbf86d3be4ea747c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:30.346583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec745d-23a9-4b46-aa11-30db8b5529cb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:30.347307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec745d-23a9-4b46-aa11-30db8b5529cb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:30.348000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec745d-23a9-4b46-aa11-30db8b5529cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:30.424988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-38ec745d-23a9-4b46-aa11-30db8b5529cb None None] MFA Rules not processed for user `d959ac9f614a432b98f2b939a6fecbaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:30.426456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-38ec745d-23a9-4b46-aa11-30db8b5529cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:30.553059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2724d-cc4b-4e9a-a59d-e20756e1832a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:30.614687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 846/1687] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:30.616058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:30.616346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:30.616619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:30.665611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:30.678906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:30.777789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:30.778458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:30.778736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:30.779007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] PATH_INFO: `/v3/users/8ca22f264fac474a808f6932217a265d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:30.782937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca22f264fac474a808f6932217a265d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:30.797134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:30.848496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 847/1688] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:30.849548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:30.856730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:30.880144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acce9b7-0550-4c26-bdd7-f3da525cbaf7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:30.895742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:30.897701 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:30.898441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:30.900561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:30.901813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:30.910128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:30.923445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca22f264fac474a808f6932217a265d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.939614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca22f264fac474a808f6932217a265d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.974168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca22f264fac474a808f6932217a265d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.982022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 848/1689] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:30 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:30.982022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:30.984964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:30.989507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca22f264fac474a808f6932217a265d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:30.990449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca22f264fac474a808f6932217a265d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:31.006747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 842/1690] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:30 2022] DELETE /identity/v3/users/8ca22f264fac474a808f6932217a265d => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:31.008096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:31.010281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.085124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:31.144975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab585-4bb2-4b72-9b34-008e1cd3cc05 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:31.207095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269eab-fce7-443b-b7de-2c16caf72eaa admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:31.208980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:31.224401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa6e8c-fac8-4e1e-a6c4-a8b9bcffd879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:31.226419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6e8c-fac8-4e1e-a6c4-a8b9bcffd879 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.226700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6e8c-fac8-4e1e-a6c4-a8b9bcffd879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.226976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6e8c-fac8-4e1e-a6c4-a8b9bcffd879 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.228641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa6e8c-fac8-4e1e-a6c4-a8b9bcffd879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:31.235268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa6e8c-fac8-4e1e-a6c4-a8b9bcffd879 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:31.305632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 843/1691] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:31 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:31.305632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2e529-288e-4268-8264-6a54acbef649 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.305881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:31.305971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2e529-288e-4268-8264-6a54acbef649 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.305971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2e529-288e-4268-8264-6a54acbef649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.306916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.306916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.306916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.313681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.333078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b8f2e529-288e-4268-8264-6a54acbef649 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:31.335037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b8f2e529-288e-4268-8264-6a54acbef649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.342671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:31.345726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 844/1692] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:31.346387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:31.347082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697b3d-d45c-46df-b868-e0b3ae089595 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.347368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697b3d-d45c-46df-b868-e0b3ae089595 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.347671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697b3d-d45c-46df-b868-e0b3ae089595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.375230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 849/1693] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:31.377608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:31.382697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.388638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-cb697b3d-d45c-46df-b868-e0b3ae089595 None None] MFA Rules not processed for user `22bc4649e5af4816b222c1097e034c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:31.390359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cb697b3d-d45c-46df-b868-e0b3ae089595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.411548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04af1c-f438-48c0-8b12-78b82f3552ea service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:31.422837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:31.423668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.424151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.424881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] PATH_INFO: `/v3/projects/356481e2fee64ff589b341f6a49f9550` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.428066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356481e2fee64ff589b341f6a49f9550)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:31.432292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:31.512560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 845/1694] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:31 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:31.517429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.520481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.521064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.549850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356481e2fee64ff589b341f6a49f9550', 'request_id': 'req-5ea002d7-f8d6-423e-ad0a-980570588183'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:31.566357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356481e2fee64ff589b341f6a49f9550', 'request_id': 'req-5ea002d7-f8d6-423e-ad0a-980570588183'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:31.576530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356481e2fee64ff589b341f6a49f9550', 'request_id': 'req-5ea002d7-f8d6-423e-ad0a-980570588183'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:31.602729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] The token cache is being invalidate because project 356481e2fee64ff589b341f6a49f9550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:31.603137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:31.603901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:31.606720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 850/1695] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:31 2022] DELETE /identity/v3/projects/356481e2fee64ff589b341f6a49f9550 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:31.613304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:31.615367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] MFA Rules not processed for user `17fdb3fb9bb04c21ba95096f1bd6e6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:31.618298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.619522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.778266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea002d7-f8d6-423e-ad0a-980570588183 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:31.784260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 846/1696] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:31.785675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:31.788650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.789465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:31.791992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.793621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.794062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.795062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:31.801180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:31.828978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 851/1697] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:31.834277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:31.839444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.866341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd490-52fe-4f13-83f6-16d04950fd72 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:31.870596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:31.881967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:31.881967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.881967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.881967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.883724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:31.891025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:31.936045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0c83-d830-4f6d-852a-c8c629409ec5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:31.947265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:31.948176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 852/1698] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:31 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:31.953244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:31.955223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:31.955731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:31.956128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:31.958652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.960244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:31.997009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:31.998484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.010210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 847/1699] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:32.011020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:32.015634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:32.022416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:32.070423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33668e-585f-439f-851a-d31f8361819f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.077259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.078204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.078792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.079375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] PATH_INFO: `/v3/users/6e9ca6daa9bb48c2bac7a804e92ebf5c` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.081435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9ca6daa9bb48c2bac7a804e92ebf5c)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:32.083770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.146801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c0b46-f2d7-4929-8957-248b5f5bcc4d service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.168289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9ca6daa9bb48c2bac7a804e92ebf5c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:32.169188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9ca6daa9bb48c2bac7a804e92ebf5c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:32.180135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9ca6daa9bb48c2bac7a804e92ebf5c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:32.180991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9ca6daa9bb48c2bac7a804e92ebf5c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:32.201230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9ca6daa9bb48c2bac7a804e92ebf5c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:32.246435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 853/1700] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:31 2022] DELETE /identity/v3/users/6e9ca6daa9bb48c2bac7a804e92ebf5c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:32.253392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:32.255102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:32.293402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.294773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.295318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.297054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.304455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:32.386989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed2feb-6e4b-4a39-aa93-46a4ffdfb41a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.404357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ea6be-5235-4608-9857-41c8a3697878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.404827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea6be-5235-4608-9857-41c8a3697878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.405110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea6be-5235-4608-9857-41c8a3697878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.405401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea6be-5235-4608-9857-41c8a3697878 admin admin] PATH_INFO: `/v3/projects/7476ecc883ff44ecbd39cf927cb55e37/users/abc2b3f6d2de42c191396392e620edf9/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.446024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ea6be-5235-4608-9857-41c8a3697878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7476ecc883ff44ecbd39cf927cb55e37, user_id=abc2b3f6d2de42c191396392e620edf9, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:32.448777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ea6be-5235-4608-9857-41c8a3697878 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.455411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:32.457231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.470808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 848/1701] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:32.479065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 854/1702] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:32 2022] PUT /identity/v3/projects/7476ecc883ff44ecbd39cf927cb55e37/users/abc2b3f6d2de42c191396392e620edf9/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:32.483816 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160837a8-c235-4c0a-ab05-da17efd95b29 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.483816 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160837a8-c235-4c0a-ab05-da17efd95b29 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.483816 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160837a8-c235-4c0a-ab05-da17efd95b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.484555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:32.488848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:32.505731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:32.509403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1003a79-5417-46d8-a90e-b7cc43274475 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.558499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-160837a8-c235-4c0a-ab05-da17efd95b29 None None] MFA Rules not processed for user `32af613bff074efa8a8605709d3eb255`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:32.559793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-160837a8-c235-4c0a-ab05-da17efd95b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:32.599984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:32.642323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.643041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.643437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.643843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.644634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:32.650432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.727714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 849/1703] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:32 2022] POST /identity/v3/users => generated 308 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:32.727714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:32.752934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8da8f-0924-4bb5-8e0a-7ad65847443c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.772781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9770e16-7459-4d4e-8c95-7d0780a85476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.773371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9770e16-7459-4d4e-8c95-7d0780a85476 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.773646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9770e16-7459-4d4e-8c95-7d0780a85476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.773913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9770e16-7459-4d4e-8c95-7d0780a85476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.774564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9770e16-7459-4d4e-8c95-7d0780a85476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:32.776205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9770e16-7459-4d4e-8c95-7d0780a85476 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.788145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 855/1704] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:32.788145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160837a8-c235-4c0a-ab05-da17efd95b29 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:32.819191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160837a8-c235-4c0a-ab05-da17efd95b29 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.824949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 850/1705] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:32.826302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4d36-04dd-4d9a-bda1-47ccbc65069e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.826595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4d36-04dd-4d9a-bda1-47ccbc65069e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.826864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4d36-04dd-4d9a-bda1-47ccbc65069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.838600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.839268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.842534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.842860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.843505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:32.845168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.888742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 856/1706] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:32.889770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:32.900539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-40dc4d36-04dd-4d9a-bda1-47ccbc65069e None None] MFA Rules not processed for user `32af613bff074efa8a8605709d3eb255`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:32.904301 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-40dc4d36-04dd-4d9a-bda1-47ccbc65069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:32.922054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280f37e-c250-4eb4-8c75-d41a2a525700 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.930716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 851/1707] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:32.935745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4d36-04dd-4d9a-bda1-47ccbc65069e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:32.945978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.946663 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.946945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.947212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] PATH_INFO: `/v3/projects/7476ecc883ff44ecbd39cf927cb55e37/users/abc2b3f6d2de42c191396392e620edf9/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:32.953973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7476ecc883ff44ecbd39cf927cb55e37, user_id=abc2b3f6d2de42c191396392e620edf9, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:32.963848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:32.972595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4d36-04dd-4d9a-bda1-47ccbc65069e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:32.990318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a1da8-7f93-4b50-bf9b-cc7416796309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:32.991002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a1da8-7f93-4b50-bf9b-cc7416796309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:32.996180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a1da8-7f93-4b50-bf9b-cc7416796309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:32.996549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a1da8-7f93-4b50-bf9b-cc7416796309 admin admin] PATH_INFO: `/v3/projects/7310b6072d3f4cef9c8b028b579a20e1/users/d676ceede79f4554ba156da244d83ab6/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:33.006380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 857/1708] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:32 2022] PUT /identity/v3/projects/7476ecc883ff44ecbd39cf927cb55e37/users/abc2b3f6d2de42c191396392e620edf9/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:33.007286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:33.017730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:33.049741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a1da8-7f93-4b50-bf9b-cc7416796309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7310b6072d3f4cef9c8b028b579a20e1, user_id=d676ceede79f4554ba156da244d83ab6, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:33.052915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a1da8-7f93-4b50-bf9b-cc7416796309 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:33.079572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 852/1709] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:32 2022] PUT /identity/v3/projects/7310b6072d3f4cef9c8b028b579a20e1/users/d676ceede79f4554ba156da244d83ab6/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:33.090047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19c83-52c8-4c34-b25f-108b549a2505 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:33.090829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19c83-52c8-4c34-b25f-108b549a2505 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:33.091034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd19c83-52c8-4c34-b25f-108b549a2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:33.165273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3cd19c83-52c8-4c34-b25f-108b549a2505 None None] MFA Rules not processed for user `abc2b3f6d2de42c191396392e620edf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:33.169425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3cd19c83-52c8-4c34-b25f-108b549a2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:33.183250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceace194-eef7-4877-9211-576cb9b615e7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:33.355042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 853/1710] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:33.356071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19c83-52c8-4c34-b25f-108b549a2505 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:33.361549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:33.362167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:33.362441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:33.362712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:33.426534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:33.481226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:33.505427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:33.507125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:33.536221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd19c83-52c8-4c34-b25f-108b549a2505 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:33.555563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 858/1711] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:33.558755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:33.559244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:33.560095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:33.560095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:33.560257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:33.560822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:33.567568 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:33.569954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:33.607813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 854/1712] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:33.609772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:33.612849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:33.618668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf5c7-4908-40eb-a732-880d7c96d38f service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:33.632683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b9ed3-7910-452a-9f18-43ada32c9125 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:33.640831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:33.641494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:33.641769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:33.642035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] PATH_INFO: `/v3/projects/67ddc8036680484cae37a9ad0e04759e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:33.643920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:33.645033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:33.645330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:33.645604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] PATH_INFO: `/v3/projects/a1cf1511bd594217baeb367680063484` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:33.648005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cf1511bd594217baeb367680063484)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:33.648803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ddc8036680484cae37a9ad0e04759e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:33.649940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:33.650679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:33.784098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cf1511bd594217baeb367680063484', 'request_id': 'req-7979cb06-7f04-4385-a45e-0f0efc3f70cc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.784708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ddc8036680484cae37a9ad0e04759e', 'request_id': 'req-dd914450-8d74-45a8-a829-e45b367a107d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.807199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cf1511bd594217baeb367680063484', 'request_id': 'req-7979cb06-7f04-4385-a45e-0f0efc3f70cc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.809591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ddc8036680484cae37a9ad0e04759e', 'request_id': 'req-dd914450-8d74-45a8-a829-e45b367a107d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.818381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cf1511bd594217baeb367680063484', 'request_id': 'req-7979cb06-7f04-4385-a45e-0f0efc3f70cc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.826707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ddc8036680484cae37a9ad0e04759e', 'request_id': 'req-dd914450-8d74-45a8-a829-e45b367a107d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.865142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] The token cache is being invalidate because project 67ddc8036680484cae37a9ad0e04759e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:33.865536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.868647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.871094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] The token cache is being invalidate because project a1cf1511bd594217baeb367680063484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:33.871457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.872037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 859/1713] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:33 2022] DELETE /identity/v3/projects/67ddc8036680484cae37a9ad0e04759e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:33.872924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:33.875400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:33.876846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:33.891060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 855/1714] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:33 2022] DELETE /identity/v3/projects/a1cf1511bd594217baeb367680063484 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:33.892220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:33.896718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:34.004842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd914450-8d74-45a8-a829-e45b367a107d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:34.012008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:34.013821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:34.014298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:34.014764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:34.029161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:34.045941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979cb06-7f04-4385-a45e-0f0efc3f70cc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:34.159194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:34.160920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:34.174298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:34.193594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 860/1715] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:34.193594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:34.196132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:34.228007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcbf2b-b7ac-4e4d-83df-f4ea2e62c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:34.229230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcbf2b-b7ac-4e4d-83df-f4ea2e62c545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:34.229524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcbf2b-b7ac-4e4d-83df-f4ea2e62c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:34.230031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcbf2b-b7ac-4e4d-83df-f4ea2e62c545 admin admin] PATH_INFO: `/v3/projects/7310b6072d3f4cef9c8b028b579a20e1/users/d676ceede79f4554ba156da244d83ab6/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:34.235677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcbf2b-b7ac-4e4d-83df-f4ea2e62c545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7310b6072d3f4cef9c8b028b579a20e1, user_id=d676ceede79f4554ba156da244d83ab6, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:34.244933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcbf2b-b7ac-4e4d-83df-f4ea2e62c545 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:34.269420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:34.303415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 856/1716] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:33 2022] PUT /identity/v3/projects/7310b6072d3f4cef9c8b028b579a20e1/users/d676ceede79f4554ba156da244d83ab6/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:34.334455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16deb9-5906-42a7-90db-d9b12fec7808 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:34.336719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16deb9-5906-42a7-90db-d9b12fec7808 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:34.336869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16deb9-5906-42a7-90db-d9b12fec7808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:34.359954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd339-8a95-4a9a-8bb8-35a3859d2aaf service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:34.400583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-da16deb9-5906-42a7-90db-d9b12fec7808 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:34.411311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-da16deb9-5906-42a7-90db-d9b12fec7808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:34.492929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:34.493729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:34.494156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:34.494521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] PATH_INFO: `/v3/projects/28195d4019ba446aae085e89450249dc` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:34.498270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28195d4019ba446aae085e89450249dc)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:34.500362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:34.597047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 857/1717] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:34.600368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:34.600773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:34.600938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:34.651608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28195d4019ba446aae085e89450249dc', 'request_id': 'req-9d4492d9-94a4-449d-b68b-9356c73f355f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:34.658872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:34.660410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:34.665410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28195d4019ba446aae085e89450249dc', 'request_id': 'req-9d4492d9-94a4-449d-b68b-9356c73f355f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:34.686737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28195d4019ba446aae085e89450249dc', 'request_id': 'req-9d4492d9-94a4-449d-b68b-9356c73f355f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:34.718775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] The token cache is being invalidate because project 28195d4019ba446aae085e89450249dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:34.719079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:34.719939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4492d9-94a4-449d-b68b-9356c73f355f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:34.723225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 861/1718] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:34 2022] DELETE /identity/v3/projects/28195d4019ba446aae085e89450249dc => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:34.727271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9f4c-f00a-4f27-a680-68ad878fa2da None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:34.727849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9f4c-f00a-4f27-a680-68ad878fa2da None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:34.728148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f9f4c-f00a-4f27-a680-68ad878fa2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:34.786179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d75f9f4c-f00a-4f27-a680-68ad878fa2da None None] MFA Rules not processed for user `a2c490a6ee594cb3826332dfa8eeb45a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:34.787681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d75f9f4c-f00a-4f27-a680-68ad878fa2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:34.884133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:34.962135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 862/1719] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:34.962135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b5653-523d-45b2-8454-f086cea48ffd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:34.962135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b5653-523d-45b2-8454-f086cea48ffd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:34.962135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b5653-523d-45b2-8454-f086cea48ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.013677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 858/1720] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:35.013677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.015164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:35.046977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b10b5a-8f9c-4bbc-89f8-c2cf1aad5265 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:35.047420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-899b5653-523d-45b2-8454-f086cea48ffd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:35.051978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-899b5653-523d-45b2-8454-f086cea48ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:35.060532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:35.061622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.062019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.062429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] PATH_INFO: `/v3/users/b2dd44e93e9940328407f36e57f167b0` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.064323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dd44e93e9940328407f36e57f167b0)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:35.070294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:35.092330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 863/1721] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:35.092330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11121fd6-5bdd-41dd-a169-db057942a47c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.092330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11121fd6-5bdd-41dd-a169-db057942a47c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.092330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11121fd6-5bdd-41dd-a169-db057942a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.148802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-11121fd6-5bdd-41dd-a169-db057942a47c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:35.150204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-11121fd6-5bdd-41dd-a169-db057942a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:35.171949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 864/1722] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:35.173082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11121fd6-5bdd-41dd-a169-db057942a47c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.196121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dd44e93e9940328407f36e57f167b0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.211079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11121fd6-5bdd-41dd-a169-db057942a47c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:35.212529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dd44e93e9940328407f36e57f167b0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.231501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:35.232159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.232435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.232699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.233536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:35.233972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:35.235878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:35.236787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dd44e93e9940328407f36e57f167b0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.260073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dd44e93e9940328407f36e57f167b0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.261043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dd44e93e9940328407f36e57f167b0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.261591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 865/1723] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:35.267868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.270308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:35.281713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 859/1724] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:35 2022] DELETE /identity/v3/users/b2dd44e93e9940328407f36e57f167b0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:35.282884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.285362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:35.301254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec4bd9-5f41-4c47-9fdb-8aed7d34475a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:35.317816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:35.460339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b9955-2354-443f-84d0-c8404d37e7e3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:35.475197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:35.476095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.476469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.477192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.482795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:35.486753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:35.492573 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a50b0-6e74-4593-9d36-9a835cea60c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:35.493214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a50b0-6e74-4593-9d36-9a835cea60c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.493488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a50b0-6e74-4593-9d36-9a835cea60c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.493755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a50b0-6e74-4593-9d36-9a835cea60c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.494440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a50b0-6e74-4593-9d36-9a835cea60c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:35.494802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a50b0-6e74-4593-9d36-9a835cea60c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:35.496558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a50b0-6e74-4593-9d36-9a835cea60c7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:35.558826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 860/1725] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:35 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:35.562694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.563708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 866/1726] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:35.565095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528f78-2498-4d7b-863f-a14d18ad6e61 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.565380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528f78-2498-4d7b-863f-a14d18ad6e61 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.565610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:35.565711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce528f78-2498-4d7b-863f-a14d18ad6e61 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.567279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 867/1727] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 16:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:35.580318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce528f78-2498-4d7b-863f-a14d18ad6e61 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.700936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce528f78-2498-4d7b-863f-a14d18ad6e61 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:35.707800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3d750-f338-48a5-97a2-6ee3f292f102 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:35.712732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:35.713200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.713779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:35.713904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.713904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.714399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:35.714818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.715383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.715570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] PATH_INFO: `/v3/users/d959ac9f614a432b98f2b939a6fecbaf` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.716417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:35.717229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d959ac9f614a432b98f2b939a6fecbaf)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:35.719284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:35.764132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 868/1728] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:35 2022] POST /identity/v3/projects => generated 391 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:35.765534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.840799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:35.896348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1a61d-51da-49c8-a1f0-fd8a3c6f5424 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:35.902710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f9be3-350c-4138-bb61-eb2bb16c19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:35.903421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f9be3-350c-4138-bb61-eb2bb16c19c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.903732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f9be3-350c-4138-bb61-eb2bb16c19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.904145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f9be3-350c-4138-bb61-eb2bb16c19c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.904966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f9be3-350c-4138-bb61-eb2bb16c19c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:35.912271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd959ac9f614a432b98f2b939a6fecbaf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.912469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f9be3-350c-4138-bb61-eb2bb16c19c6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:35.930576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd959ac9f614a432b98f2b939a6fecbaf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.950279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd959ac9f614a432b98f2b939a6fecbaf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.964187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd959ac9f614a432b98f2b939a6fecbaf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.967819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 869/1729] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:35 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:35.967819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:35.967819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:35.967819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:35.970381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd959ac9f614a432b98f2b939a6fecbaf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:35.984076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 861/1730] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:35 2022] DELETE /identity/v3/users/d959ac9f614a432b98f2b939a6fecbaf => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:35.985366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:35.987995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.025363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:36.064597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] MFA Rules not processed for user `2fdb46b5aa2c477d8abce5a1eb9fb68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:36.066097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.157226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e65b1-7b5b-464d-aa6b-7460513555ba admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.170011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d56f6-b0e5-4666-86f7-2c4d42642cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.171011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d56f6-b0e5-4666-86f7-2c4d42642cee admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.181539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d56f6-b0e5-4666-86f7-2c4d42642cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.181875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d56f6-b0e5-4666-86f7-2c4d42642cee admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.182591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d56f6-b0e5-4666-86f7-2c4d42642cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.185579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d56f6-b0e5-4666-86f7-2c4d42642cee admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.210590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 870/1731] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:39:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:36.212149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.213728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.242576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da4c56-d3cd-49f3-a821-904aca36f1b1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.248646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 862/1732] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:35 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:36.251914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cada4-6226-409b-ad83-78bc215cbec4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.252294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cada4-6226-409b-ad83-78bc215cbec4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.252804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cada4-6226-409b-ad83-78bc215cbec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.259122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.259859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.260212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.260558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.261383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.263158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.286718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 871/1733] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:36.288021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.289812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.295522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f50cada4-6226-409b-ad83-78bc215cbec4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:36.307275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f50cada4-6226-409b-ad83-78bc215cbec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.324120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b8a8f-074d-476f-83a3-4ff91d42f038 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.332378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 863/1734] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:36.333822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cada4-6226-409b-ad83-78bc215cbec4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.335400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.336147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.336660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.337024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.347476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cada4-6226-409b-ad83-78bc215cbec4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.354767 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.356102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.356735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.357182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.358371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.359391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.360438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.365122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.378492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 864/1735] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:36.380676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.390066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 872/1736] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:36.391628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.394343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.417599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930eb7e5-f39d-46f5-9868-e64bcbda3003 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.430553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e19402-128d-44e0-baa9-cd10641acd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.431182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e19402-128d-44e0-baa9-cd10641acd68 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.431459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e19402-128d-44e0-baa9-cd10641acd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.432071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e19402-128d-44e0-baa9-cd10641acd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.432724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e19402-128d-44e0-baa9-cd10641acd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.435937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce2274-08ca-4fd0-a186-41e93e9f3a52 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.439680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e19402-128d-44e0-baa9-cd10641acd68 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.452579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.452806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.453183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.453560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] PATH_INFO: `/v3/projects/54628fbdcb4c4aeeb2a97568ce667a9c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.455024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54628fbdcb4c4aeeb2a97568ce667a9c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.457584 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.466538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 873/1737] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:36.466538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.466824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.466909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.534465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] MFA Rules not processed for user `d676ceede79f4554ba156da244d83ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:36.537918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.556947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54628fbdcb4c4aeeb2a97568ce667a9c', 'request_id': 'req-54c0188e-6043-479e-a9bf-17b4e6873a55'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:36.570837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54628fbdcb4c4aeeb2a97568ce667a9c', 'request_id': 'req-54c0188e-6043-479e-a9bf-17b4e6873a55'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:36.581161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54628fbdcb4c4aeeb2a97568ce667a9c', 'request_id': 'req-54c0188e-6043-479e-a9bf-17b4e6873a55'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:36.596142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] The token cache is being invalidate because project 54628fbdcb4c4aeeb2a97568ce667a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:36.596551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:36.597386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:36.599898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 865/1738] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:36 2022] DELETE /identity/v3/projects/54628fbdcb4c4aeeb2a97568ce667a9c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:36.600797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.602530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.682816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0188e-6043-479e-a9bf-17b4e6873a55 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.687246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.688202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.688581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.688949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.691109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.718285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 874/1739] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:36.719384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.723674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.727395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:36.765105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:36.807236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.809757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.823046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 866/1740] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:36.824253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.825865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:36.846110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9e55-552f-4bb6-b695-d11f3e5ec2c7 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.855182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.856485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.857060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.857726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] PATH_INFO: `/v3/projects/6660b857356d4682b05473d7ff2091a3/users/02b7d1b52c024cadaa402dbd09123184/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.866019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d372-d504-4c19-86d5-1b1cde2df583 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:36.874683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08437c3a-9f2e-4aaa-a766-9fbfde065718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:36.875241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437c3a-9f2e-4aaa-a766-9fbfde065718 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.875518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437c3a-9f2e-4aaa-a766-9fbfde065718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.876199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08437c3a-9f2e-4aaa-a766-9fbfde065718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.876872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437c3a-9f2e-4aaa-a766-9fbfde065718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.878765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08437c3a-9f2e-4aaa-a766-9fbfde065718 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.879913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6660b857356d4682b05473d7ff2091a3, user_id=02b7d1b52c024cadaa402dbd09123184, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:36.883255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:36.906322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 875/1741] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:36.906322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180196-0f68-454d-a076-5568c76b8538 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.906322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180196-0f68-454d-a076-5568c76b8538 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.906322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180196-0f68-454d-a076-5568c76b8538 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.908161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 876/1742] 10.222.0.88 () {54 vars in 912 bytes} [Wed Aug 24 16:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:36.910175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185223b-da21-4e27-9417-1adf1247004c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:36.910461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185223b-da21-4e27-9417-1adf1247004c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:36.910735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185223b-da21-4e27-9417-1adf1247004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:36.928435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 867/1743] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:36 2022] PUT /identity/v3/projects/6660b857356d4682b05473d7ff2091a3/users/02b7d1b52c024cadaa402dbd09123184/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:36.930213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:36.934794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9185223b-da21-4e27-9417-1adf1247004c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:36.936623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9185223b-da21-4e27-9417-1adf1247004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:37.023449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 877/1744] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:37.024835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb194304-777a-4d19-810f-2e0bb4d648b5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.025127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb194304-777a-4d19-810f-2e0bb4d648b5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.025599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb194304-777a-4d19-810f-2e0bb4d648b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.032690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f2f8-1cf0-48bf-8cde-66f87901e637 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:37.039544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fa430-aad1-4af4-91b0-5916cfa6d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:37.041891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa430-aad1-4af4-91b0-5916cfa6d844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.042247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa430-aad1-4af4-91b0-5916cfa6d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.042610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa430-aad1-4af4-91b0-5916cfa6d844 admin admin] PATH_INFO: `/v3/projects/62ea4dff685045c7a6e30d9af608b79a/users/867f53740127472282da3521ec3c7a3f/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.061782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fb194304-777a-4d19-810f-2e0bb4d648b5 None None] MFA Rules not processed for user `2fdb46b5aa2c477d8abce5a1eb9fb68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:37.063727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fb194304-777a-4d19-810f-2e0bb4d648b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:37.072812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fa430-aad1-4af4-91b0-5916cfa6d844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ea4dff685045c7a6e30d9af608b79a, user_id=867f53740127472282da3521ec3c7a3f, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:37.083057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fa430-aad1-4af4-91b0-5916cfa6d844 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:37.106906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 868/1745] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:36 2022] PUT /identity/v3/projects/62ea4dff685045c7a6e30d9af608b79a/users/867f53740127472282da3521ec3c7a3f/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:37.125734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.126219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.126713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.156083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 878/1746] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:37.157482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced9fc-727c-44f9-9709-317d2306317b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.158152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced9fc-727c-44f9-9709-317d2306317b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.159270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced9fc-727c-44f9-9709-317d2306317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.182518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cbced9fc-727c-44f9-9709-317d2306317b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:37.184024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cbced9fc-727c-44f9-9709-317d2306317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:37.211027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] MFA Rules not processed for user `02b7d1b52c024cadaa402dbd09123184`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:37.212430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:37.250674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:37.266963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 879/1747] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:37.268474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e3e5-b289-43be-920d-396afe993284 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.268825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e3e5-b289-43be-920d-396afe993284 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.269089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e3e5-b289-43be-920d-396afe993284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.341841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-da51e3e5-b289-43be-920d-396afe993284 None None] MFA Rules not processed for user `867f53740127472282da3521ec3c7a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:37.345826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-da51e3e5-b289-43be-920d-396afe993284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:37.387353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 869/1748] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:37.387353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:37.390710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:37.414545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:37.568750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f6b50-6a41-47f9-a8cd-f5772638a2c4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:37.570862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 880/1749] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:37.571738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e3e5-b289-43be-920d-396afe993284 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:37.583524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:37.584325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.589088 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.589948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.597927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e3e5-b289-43be-920d-396afe993284 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:37.600453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:37.601964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:37.613687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 870/1750] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:37.614620 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:37.628447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:37.629068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.629350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.629937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.630290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:37.630587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:37.631194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab4fa9-2daf-40d4-93db-ec42e9bb011d service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:37.632575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:37.659075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:37.659824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.660105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.660376 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.661004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:37.669336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:37.670902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 881/1751] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:37.672066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:37.706094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c8de9-dd7c-44bc-a729-1fb5961bb76c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:37.719696 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 871/1752] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:37.721340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9440d-fc89-4e31-ad4d-ade890a78926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:37.721980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9440d-fc89-4e31-ad4d-ade890a78926 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.722602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9440d-fc89-4e31-ad4d-ade890a78926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.722891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9440d-fc89-4e31-ad4d-ade890a78926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.723536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9440d-fc89-4e31-ad4d-ade890a78926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:37.723715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:37.725496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9440d-fc89-4e31-ad4d-ade890a78926 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:37.790063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 882/1753] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:37.791604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09a627-bf46-4775-8fc5-ea2a13e2678a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.791945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09a627-bf46-4775-8fc5-ea2a13e2678a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.792223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09a627-bf46-4775-8fc5-ea2a13e2678a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.795021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 883/1754] 10.222.0.88 () {54 vars in 961 bytes} [Wed Aug 24 16:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:37.803234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09a627-bf46-4775-8fc5-ea2a13e2678a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:37.846632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e0ba8-d529-41b3-8d4d-6f95c06fe2cd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:37.960228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:37.961027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.961305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.961625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.962323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:37.964496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:37.981124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09a627-bf46-4775-8fc5-ea2a13e2678a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:37.986898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c54e1-78d0-42c4-9a11-7749274694b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:37.987611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c54e1-78d0-42c4-9a11-7749274694b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:37.987870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c54e1-78d0-42c4-9a11-7749274694b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:37.988137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c54e1-78d0-42c4-9a11-7749274694b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:37.993751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c54e1-78d0-42c4-9a11-7749274694b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:37.996660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c54e1-78d0-42c4-9a11-7749274694b5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.009435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 872/1755] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/projects => generated 369 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:38.010495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.022870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 884/1756] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:37 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:38.024412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.024607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.024899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.056054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:38.057597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.074963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:38.122960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:38.144501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49787ae-1610-4981-be73-6067c7aa455b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.150384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.151109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.151432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.151780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.154149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.154934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.159925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 885/1757] 10.222.0.88 () {58 vars in 1058 bytes} [Wed Aug 24 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:38.160988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.162792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.184460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96542426-2746-4e86-b5d2-6f6ad7549735 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.187939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 873/1758] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:38 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:38.189156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.195184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.196528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.196807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.197711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] PATH_INFO: `/v3/projects/005b7d89290241aaa7d7dde88ac70008` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.200070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005b7d89290241aaa7d7dde88ac70008)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.201976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.202331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb398-38c4-4c00-b33d-a3f8d102c677 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.208202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.209248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.209720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.210667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.211421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.226004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.279900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 874/1759] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:38 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:38.281432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.284502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005b7d89290241aaa7d7dde88ac70008', 'request_id': 'req-e9342853-fc40-4035-a45f-79f125c517d5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.294226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005b7d89290241aaa7d7dde88ac70008', 'request_id': 'req-e9342853-fc40-4035-a45f-79f125c517d5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.302298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd225dd9-42b9-414b-af96-dc8dffa5b2ff admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.320909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005b7d89290241aaa7d7dde88ac70008', 'request_id': 'req-e9342853-fc40-4035-a45f-79f125c517d5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.343982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] The token cache is being invalidate because project 005b7d89290241aaa7d7dde88ac70008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:38.344500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.345255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.347210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 886/1760] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:38 2022] DELETE /identity/v3/projects/005b7d89290241aaa7d7dde88ac70008 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:38.348279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.350613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.382134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.383120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.383461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.383844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.384591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.387734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.400493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 875/1761] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:38.401234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.407917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.422756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d00a21-f151-465f-9d60-df284b5c61dd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.428190 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.428879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.429094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.429372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.430058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.431754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.446609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 876/1762] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:38.446609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.446609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.461388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7156a4-76e8-4b77-b342-b98e958f05ca admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.467260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.467924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.468200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.468469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.469117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.470737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.471417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9342853-fc40-4035-a45f-79f125c517d5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.484690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.491829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.492323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.492592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.494700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 877/1763] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:38.495414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.498460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.502637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.512644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b498c-60d2-4cea-92c8-0f82006126ac admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.518095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.519340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.519771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.520141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] PATH_INFO: `/v3/users/abc2b3f6d2de42c191396392e620edf9` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.521630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc2b3f6d2de42c191396392e620edf9)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.524162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.534121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.536354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.551928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 887/1764] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:38.553763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.555939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.578429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ba2b5-1b8e-4db5-8165-f66fcb986783 service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.591528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.592440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.593903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.594809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] PATH_INFO: `/v3/projects/b7e139a202be43508c63546b88dfc9fc/users/cf6d5e0f19804b978f2eff09e77334c2/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.602624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc2b3f6d2de42c191396392e620edf9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.613919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc2b3f6d2de42c191396392e620edf9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.624324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:38.634006 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e139a202be43508c63546b88dfc9fc, user_id=cf6d5e0f19804b978f2eff09e77334c2, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.641203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc2b3f6d2de42c191396392e620edf9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.643786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.666263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc2b3f6d2de42c191396392e620edf9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.667792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc2b3f6d2de42c191396392e620edf9'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:38.686711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 878/1765] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:38 2022] DELETE /identity/v3/users/abc2b3f6d2de42c191396392e620edf9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:38.689814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 888/1766] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:38 2022] PUT /identity/v3/projects/b7e139a202be43508c63546b88dfc9fc/users/cf6d5e0f19804b978f2eff09e77334c2/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:38.689947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.690029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.692997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.731561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:38.847390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74df5-0a5a-4e11-b9eb-c8fa54b1a7e5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.856910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:38.857573 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:38.858432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:38.858861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:38.859345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] PATH_INFO: `/v3/projects/92a15d66ac224459b4f337a562da396d/users/fdaeb2659a4c46f48728450309866e6c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:38.895590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a15d66ac224459b4f337a562da396d, user_id=fdaeb2659a4c46f48728450309866e6c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:38.902354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:38.930667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa5d07-70b1-4ce0-9c6f-66baa48ad447 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:38.936134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 879/1767] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:38 2022] PUT /identity/v3/projects/92a15d66ac224459b4f337a562da396d/users/fdaeb2659a4c46f48728450309866e6c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:38.936134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:38.936785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:39.117900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:39.120650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.122585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.123031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.124211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:39.128059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:39.128319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd8b65-14ed-4dbc-957f-5b5aa9c7e77a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:39.142542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401caa-dee4-4bfe-9bea-cbdcb7aca8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:39.143509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401caa-dee4-4bfe-9bea-cbdcb7aca8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.144665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401caa-dee4-4bfe-9bea-cbdcb7aca8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.145621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401caa-dee4-4bfe-9bea-cbdcb7aca8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.147470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38401caa-dee4-4bfe-9bea-cbdcb7aca8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:39.152920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38401caa-dee4-4bfe-9bea-cbdcb7aca8ba admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:39.162912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 889/1768] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:39.165290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:39.184006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 880/1769] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:39.187334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917868-f642-4909-8544-e3f9a8144c6d None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.188080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917868-f642-4909-8544-e3f9a8144c6d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.191045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d917868-f642-4909-8544-e3f9a8144c6d None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.194082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd02ad0-7744-465d-b5e7-03abeff0687f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:39.196013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 881/1770] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:39:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:39.198220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917868-f642-4909-8544-e3f9a8144c6d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:39.207973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:39.210824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.211643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.212177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.213547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:39.219861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:39.234699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d917868-f642-4909-8544-e3f9a8144c6d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:39.251050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0c80-a3c2-4f33-92d8-d191208bd5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:39.252156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0c80-a3c2-4f33-92d8-d191208bd5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.252596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0c80-a3c2-4f33-92d8-d191208bd5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.253088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 890/1771] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:39.253489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0c80-a3c2-4f33-92d8-d191208bd5f4 admin admin] PATH_INFO: `/v3/projects/eb937080d1704a198c7154ae0e706e72/users/5a6f4c0b91084852b309cd18ce6afb2e/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.254484 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:39.329638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511f7e1-3e61-4fc4-b995-69ff4f97c54a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:39.331945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af0c80-a3c2-4f33-92d8-d191208bd5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb937080d1704a198c7154ae0e706e72, user_id=5a6f4c0b91084852b309cd18ce6afb2e, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:39.336488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af0c80-a3c2-4f33-92d8-d191208bd5f4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:39.342426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:39.343116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.343398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.343718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] PATH_INFO: `/v3/projects/b7e139a202be43508c63546b88dfc9fc/users/cf6d5e0f19804b978f2eff09e77334c2/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.347570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e139a202be43508c63546b88dfc9fc, user_id=cf6d5e0f19804b978f2eff09e77334c2, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:39.351703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:39.366518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 882/1772] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:39 2022] PUT /identity/v3/projects/eb937080d1704a198c7154ae0e706e72/users/5a6f4c0b91084852b309cd18ce6afb2e/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:39.368540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991fe0f-0877-42bd-9c8b-9a86f717f032 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.368826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991fe0f-0877-42bd-9c8b-9a86f717f032 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.369088 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991fe0f-0877-42bd-9c8b-9a86f717f032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.394244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 891/1773] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:39 2022] PUT /identity/v3/projects/b7e139a202be43508c63546b88dfc9fc/users/cf6d5e0f19804b978f2eff09e77334c2/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:39.395403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:39.462865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f991fe0f-0877-42bd-9c8b-9a86f717f032 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:39.464149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f991fe0f-0877-42bd-9c8b-9a86f717f032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:39.498378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12c1f7-bc01-485d-9cef-f97201ed344b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:39.504502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:39.505238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.505583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.506025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] PATH_INFO: `/v3/projects/92a15d66ac224459b4f337a562da396d/users/fdaeb2659a4c46f48728450309866e6c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.508255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a15d66ac224459b4f337a562da396d, user_id=fdaeb2659a4c46f48728450309866e6c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:39.511388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:39.537070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 892/1774] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:39 2022] PUT /identity/v3/projects/92a15d66ac224459b4f337a562da396d/users/fdaeb2659a4c46f48728450309866e6c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:39.538275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:39.540567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:39.553370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:39.620646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:39.621695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 883/1775] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:39.624793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af59a-3532-44d2-ba15-af230fc3c09c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.625095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af59a-3532-44d2-ba15-af230fc3c09c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.625523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47af59a-3532-44d2-ba15-af230fc3c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.654053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eaf09-e5c4-4c30-b6a1-bf830e3e1844 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:39.661603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:39.662441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.662895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.663480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] PATH_INFO: `/v3/projects/7476ecc883ff44ecbd39cf927cb55e37` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.664952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7476ecc883ff44ecbd39cf927cb55e37)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:39.667396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:39.682171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b47af59a-3532-44d2-ba15-af230fc3c09c None None] MFA Rules not processed for user `5a6f4c0b91084852b309cd18ce6afb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:39.684318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b47af59a-3532-44d2-ba15-af230fc3c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:39.752137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7476ecc883ff44ecbd39cf927cb55e37', 'request_id': 'req-7eac210c-bd76-4b3e-b45c-2904223e549d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:39.769342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7476ecc883ff44ecbd39cf927cb55e37', 'request_id': 'req-7eac210c-bd76-4b3e-b45c-2904223e549d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:39.786977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7476ecc883ff44ecbd39cf927cb55e37', 'request_id': 'req-7eac210c-bd76-4b3e-b45c-2904223e549d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:39.817913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] The token cache is being invalidate because project 7476ecc883ff44ecbd39cf927cb55e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:39.818962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:39.833002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eac210c-bd76-4b3e-b45c-2904223e549d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:39.846824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 893/1776] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:39 2022] DELETE /identity/v3/projects/7476ecc883ff44ecbd39cf927cb55e37 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:39.850296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.850579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.853066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.878501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 884/1777] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:39.878501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14ad55-c099-43b4-88e0-6d917db8c249 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:39.878501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14ad55-c099-43b4-88e0-6d917db8c249 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:39.878501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14ad55-c099-43b4-88e0-6d917db8c249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:39.914815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] MFA Rules not processed for user `cf6d5e0f19804b978f2eff09e77334c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:39.916881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:39.952821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6d14ad55-c099-43b4-88e0-6d917db8c249 None None] MFA Rules not processed for user `fdaeb2659a4c46f48728450309866e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:39.954000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6d14ad55-c099-43b4-88e0-6d917db8c249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.017317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 894/1778] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:40.018348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:40.019715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.110966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:40.134070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 885/1779] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:40.140106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.140514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.141593 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.143291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad217df-a1ed-4396-9ea3-136e064accc1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:40.151696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:40.152484 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.152960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.153252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.156249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.170834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:40.172901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:40.190386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 895/1780] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:40.192266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:40.194062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.207994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:40.212895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.302994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269da10-f8ff-4c0d-a612-c27673580b33 service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:40.312242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:40.312956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.313295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.314009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.315516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:40.318729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:40.336022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:40.369789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 896/1781] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:40 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:40.369789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:40.373031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.377949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 886/1782] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:40.379886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:40.381231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.525789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97e905-fc4c-408a-a7cb-18ae91d33da0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:40.547224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753de5ca-4180-470e-a5d7-d33a7343249d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:40.548900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79852d1b-eb68-4db4-a8b5-f595d4402c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:40.561032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79852d1b-eb68-4db4-a8b5-f595d4402c6b service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.561032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79852d1b-eb68-4db4-a8b5-f595d4402c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.561309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79852d1b-eb68-4db4-a8b5-f595d4402c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.566807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:40.567461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.571143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.571441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.667188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:40.670314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:40.693909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 897/1783] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:40.706878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:40.774397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:40.790237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79852d1b-eb68-4db4-a8b5-f595d4402c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:40.795352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79852d1b-eb68-4db4-a8b5-f595d4402c6b service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:40.842329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 887/1784] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:40.844338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff1616-057c-4a9e-b3e2-795efe5122ee None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.844824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff1616-057c-4a9e-b3e2-795efe5122ee None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.845286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff1616-057c-4a9e-b3e2-795efe5122ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.895225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2d39d-2cc6-48dd-9e96-66426fa7af96 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:40.903267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65a4c-dd46-4b88-bdca-ca6050350bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:40.904690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65a4c-dd46-4b88-bdca-ca6050350bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.905178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65a4c-dd46-4b88-bdca-ca6050350bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.905685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65a4c-dd46-4b88-bdca-ca6050350bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.906559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65a4c-dd46-4b88-bdca-ca6050350bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:40.910459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65a4c-dd46-4b88-bdca-ca6050350bf8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:40.916217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0dff1616-057c-4a9e-b3e2-795efe5122ee None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:40.922974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0dff1616-057c-4a9e-b3e2-795efe5122ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:40.967390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 898/1785] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:40 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:40.967390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d782ee-2ba7-47c4-9994-b85101a0b159 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:40.967390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d782ee-2ba7-47c4-9994-b85101a0b159 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:40.967390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d782ee-2ba7-47c4-9994-b85101a0b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:40.968258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 888/1786] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:40.969588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff1616-057c-4a9e-b3e2-795efe5122ee None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:40.992991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff1616-057c-4a9e-b3e2-795efe5122ee None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:40.999785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.000786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.001350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.002102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b5d782ee-2ba7-47c4-9994-b85101a0b159 None None] MFA Rules not processed for user `17fdb3fb9bb04c21ba95096f1bd6e6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:41.002358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.003541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b5d782ee-2ba7-47c4-9994-b85101a0b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:41.005206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:41.089149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 899/1787] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:41.094267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d782ee-2ba7-47c4-9994-b85101a0b159 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.116197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d782ee-2ba7-47c4-9994-b85101a0b159 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.119705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.121650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.128439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.129062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.129340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.129613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.130274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:41.130577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.132579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.155124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 889/1788] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:41.156470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.184080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 900/1789] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:41.185009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.186359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0c00f-d859-4acb-b96f-89a4d640f626 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.194771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.195689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.196140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.196632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.197575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.203103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.228801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ceda0-b032-4f2d-bfd9-ec0f665e31f7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.249896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.253014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.253409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.253784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.256367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:41.262632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 890/1790] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:41.267176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.286005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc70da-724a-42f2-9b28-7f2443f16469 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.292923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.293928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.294444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.294690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.295343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.299666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.326668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:41.357161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 891/1791] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:41 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:41.358599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.408497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.409639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.456041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 901/1792] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:41.457302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.498539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537937f7-c437-44d7-b8cc-2b1ff56a8091 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.595550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34915a8-da12-40c7-9290-3340b3a5819c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.619982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.621068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.621345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.621612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] PATH_INFO: `/v3/projects/13161b8deb65445b846e82fa8de0e117/users/51a1dffccead41eabea67a8991fbfa15/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.655635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:41.676167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13161b8deb65445b846e82fa8de0e117, user_id=51a1dffccead41eabea67a8991fbfa15, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.679546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.728464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 892/1793] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:41 2022] PUT /identity/v3/projects/13161b8deb65445b846e82fa8de0e117/users/51a1dffccead41eabea67a8991fbfa15/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:41.729676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.745455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.746187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.746581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.746858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.749237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.754236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.818951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 902/1794] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:41 2022] POST /identity/v3/users => generated 289 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:41.831108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.856739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a1fe6-4865-4935-bc26-465538305431 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.870674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258b7d-89ce-4c2a-9fc1-9f84518f9a5b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.871819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.872455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.872732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.872999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.877242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.881899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.887628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e80aa-023b-49d7-8a2f-42783fe92676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.892328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e80aa-023b-49d7-8a2f-42783fe92676 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.894922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e80aa-023b-49d7-8a2f-42783fe92676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.895316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e80aa-023b-49d7-8a2f-42783fe92676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.897205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e80aa-023b-49d7-8a2f-42783fe92676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.905610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e80aa-023b-49d7-8a2f-42783fe92676 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.918033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 903/1795] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:41.921636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.934704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 893/1796] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:39:41.939151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b804c9-a056-4935-b8fb-5deb6e4694fc None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.939478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b804c9-a056-4935-b8fb-5deb6e4694fc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.939815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b804c9-a056-4935-b8fb-5deb6e4694fc None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.942628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02cb68-065f-4583-abde-cb96a6ab004f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.944502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 894/1797] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:39:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:41.949241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b804c9-a056-4935-b8fb-5deb6e4694fc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:41.976401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b944b-cbe6-4292-9e33-71169049f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.979888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b944b-cbe6-4292-9e33-71169049f9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:41.980612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b944b-cbe6-4292-9e33-71169049f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:41.981260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b944b-cbe6-4292-9e33-71169049f9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:41.982335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b944b-cbe6-4292-9e33-71169049f9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:41.982651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b804c9-a056-4935-b8fb-5deb6e4694fc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:41.996331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b944b-cbe6-4292-9e33-71169049f9ef admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:41.999119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:41.999851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.000126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.000399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] PATH_INFO: `/v3/projects/13161b8deb65445b846e82fa8de0e117/users/51a1dffccead41eabea67a8991fbfa15/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.003397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13161b8deb65445b846e82fa8de0e117, user_id=51a1dffccead41eabea67a8991fbfa15, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:42.006943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:42.036197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 904/1798] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:42.036197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890e7c-642d-498a-ad57-02458b74f084 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.036197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890e7c-642d-498a-ad57-02458b74f084 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.036197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890e7c-642d-498a-ad57-02458b74f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.045882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 895/1799] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:41 2022] PUT /identity/v3/projects/13161b8deb65445b846e82fa8de0e117/users/51a1dffccead41eabea67a8991fbfa15/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:42.048552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:42.064846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:42.125758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-92890e7c-642d-498a-ad57-02458b74f084 None None] MFA Rules not processed for user `d8fe69ee335b461fbfa55620f104beb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:42.126736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-92890e7c-642d-498a-ad57-02458b74f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:42.261144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae542d0-705a-437a-9475-021522d9705e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:42.271505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:42.272354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.273284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.273637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] PATH_INFO: `/v3/users/22bc4649e5af4816b222c1097e034c54` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.275771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bc4649e5af4816b222c1097e034c54)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:42.279023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:42.282201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:42.369881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 905/1800] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:42.370924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890e7c-642d-498a-ad57-02458b74f084 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:42.411208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890e7c-642d-498a-ad57-02458b74f084 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:42.444784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b589233-4b78-4998-bb90-cc3313426052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:42.447751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b589233-4b78-4998-bb90-cc3313426052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.448033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b589233-4b78-4998-bb90-cc3313426052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.448321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b589233-4b78-4998-bb90-cc3313426052 admin admin] PATH_INFO: `/v3/projects/cb6c81624fff4bdf8a2745578486582c/users/6bc5e47536864552908ba552c0f57a36/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.463540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bc4649e5af4816b222c1097e034c54'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:42.495821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bc4649e5af4816b222c1097e034c54'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:42.496959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b589233-4b78-4998-bb90-cc3313426052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6c81624fff4bdf8a2745578486582c, user_id=6bc5e47536864552908ba552c0f57a36, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:42.502398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b589233-4b78-4998-bb90-cc3313426052 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:42.524132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bc4649e5af4816b222c1097e034c54'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:42.535023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 906/1801] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:42 2022] PUT /identity/v3/projects/cb6c81624fff4bdf8a2745578486582c/users/6bc5e47536864552908ba552c0f57a36/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:42.535271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2169f-f5ea-49de-8020-cb98a9b2ab59 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.535615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2169f-f5ea-49de-8020-cb98a9b2ab59 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.535852 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2169f-f5ea-49de-8020-cb98a9b2ab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.541343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bc4649e5af4816b222c1097e034c54'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:42.543359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bc4649e5af4816b222c1097e034c54'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:42.560880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 896/1802] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:42 2022] DELETE /identity/v3/users/22bc4649e5af4816b222c1097e034c54 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:42.560880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:42.560880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:42.617773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d0c2169f-f5ea-49de-8020-cb98a9b2ab59 None None] MFA Rules not processed for user `51a1dffccead41eabea67a8991fbfa15`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:42.622196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d0c2169f-f5ea-49de-8020-cb98a9b2ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:42.767084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9fdab-fc32-489b-862d-0a5aa6b0d4d6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:42.779633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d56ad-5aaa-4869-a68e-e307e6cf4f82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:42.780483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d56ad-5aaa-4869-a68e-e307e6cf4f82 service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.780762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d56ad-5aaa-4869-a68e-e307e6cf4f82 service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.781034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d56ad-5aaa-4869-a68e-e307e6cf4f82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.788407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-082d56ad-5aaa-4869-a68e-e307e6cf4f82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:42.802107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 907/1803] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:42.808977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.809274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.809683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.822045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d56ad-5aaa-4869-a68e-e307e6cf4f82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:42.822823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:42.832500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d56ad-5aaa-4869-a68e-e307e6cf4f82 service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:42.860997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 897/1804] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:42.863499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:42.863805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:42.866367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:42.897164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] MFA Rules not processed for user `6bc5e47536864552908ba552c0f57a36`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:42.898384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:43.040009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:43.041287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:43.105400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 908/1805] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:43.108318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:43.125847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:43.161511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:43.243253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 898/1806] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:43.244075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:43.248365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:43.326374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c5b4-78e1-48d4-89b2-fca611f8d941 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:43.350098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:43.350986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:43.351276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:43.351558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:43.376025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:43.377586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:43.411342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 909/1807] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:43.412940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:43.414905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:43.507774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cb032-421c-4f75-81e3-0e85e8cd209f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:43.544097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:43.546702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:43.547714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:43.548407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] PATH_INFO: `/v3/projects/e56ac2a6467541baa4dfc801075cafce` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:43.552999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56ac2a6467541baa4dfc801075cafce)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:43.562012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:43.565012 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3986668-db2b-469c-a188-6d38ede313b9 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:43.575278 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:43.575951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:43.576233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:43.576503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:43.577173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:43.582531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:43.661526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 910/1808] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:43 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:43.663351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:43.670324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:43.726386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56ac2a6467541baa4dfc801075cafce', 'request_id': 'req-6d7d82bb-8760-49bf-9fd2-fa985e4245be'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:43.742839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:43.748353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56ac2a6467541baa4dfc801075cafce', 'request_id': 'req-6d7d82bb-8760-49bf-9fd2-fa985e4245be'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:43.759091 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56ac2a6467541baa4dfc801075cafce', 'request_id': 'req-6d7d82bb-8760-49bf-9fd2-fa985e4245be'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:43.803213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] The token cache is being invalidate because project e56ac2a6467541baa4dfc801075cafce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:43.803523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:43.804606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:43.807610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 899/1809] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:43 2022] DELETE /identity/v3/projects/e56ac2a6467541baa4dfc801075cafce => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:43.809373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:43.813647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:43.898051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86001ec-332f-4912-8e93-8d22a6a12020 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:43.944750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d82bb-8760-49bf-9fd2-fa985e4245be admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:43.951409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:43.952111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:43.952413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:43.952657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:43.953672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:43.955769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:44.029316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 900/1810] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:43 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:44.034122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:44.054047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:44.064426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:44.065906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:44.067810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:44.068285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:44.074737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:44.075755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:44.090380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6392328-a2c3-4a06-92c3-143a2a347363 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:44.098695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:44.099491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:44.100048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:44.100892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] PATH_INFO: `/v3/users/d676ceede79f4554ba156da244d83ab6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:44.102132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d676ceede79f4554ba156da244d83ab6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:44.105273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:44.220228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd676ceede79f4554ba156da244d83ab6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:44.233145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:44.235134 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:44.243732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd676ceede79f4554ba156da244d83ab6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:44.258143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 911/1811] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:39:44.259180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:44.298584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176d021-5f4d-476a-9ef9-59d355803286 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:44.306254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd676ceede79f4554ba156da244d83ab6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:44.320718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:44.321456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:44.321739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:44.322259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:44.323181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:44.325608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:44.359511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd676ceede79f4554ba156da244d83ab6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:44.361248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 912/1812] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:44.362328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd676ceede79f4554ba156da244d83ab6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:44.366189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:44.387507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 901/1813] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:44 2022] DELETE /identity/v3/users/d676ceede79f4554ba156da244d83ab6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:44.395793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:44.441343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e6e5a-7bb9-4d7c-bf8f-adae538f4cc8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:44.563692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:44.664778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:44.665524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:44.671767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:44.672810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] PATH_INFO: `/v3/projects/efd7f65698f94df2b6eab3aa15ff3e76/users/a8f16be00ae64916b7f7e6416a0eca60/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:44.728182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd7f65698f94df2b6eab3aa15ff3e76, user_id=a8f16be00ae64916b7f7e6416a0eca60, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:44.733126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:44.783078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 913/1814] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:44 2022] PUT /identity/v3/projects/efd7f65698f94df2b6eab3aa15ff3e76/users/a8f16be00ae64916b7f7e6416a0eca60/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:44.787513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:44.818814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab7119-b79a-449a-aefb-13a3590ef363 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:45.022668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:45.025034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:45.114631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:45.115522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:45.115826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:45.116100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:45.116812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:45.122098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:45.156355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 902/1815] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:45.157726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:45.184963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4098e0-f53c-419e-90b3-62b34995586a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:45.199675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1ce44-6079-4dd2-ad73-14702e93739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:45.200414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ce44-6079-4dd2-ad73-14702e93739a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:45.200939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ce44-6079-4dd2-ad73-14702e93739a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:45.201304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ce44-6079-4dd2-ad73-14702e93739a admin admin] PATH_INFO: `/v3/projects/efd7f65698f94df2b6eab3aa15ff3e76/users/a8f16be00ae64916b7f7e6416a0eca60/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:45.209327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1ce44-6079-4dd2-ad73-14702e93739a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd7f65698f94df2b6eab3aa15ff3e76, user_id=a8f16be00ae64916b7f7e6416a0eca60, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:45.212846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1ce44-6079-4dd2-ad73-14702e93739a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:45.251135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 903/1816] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:45 2022] PUT /identity/v3/projects/efd7f65698f94df2b6eab3aa15ff3e76/users/a8f16be00ae64916b7f7e6416a0eca60/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:45.256519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:45.256808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:45.257133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:45.305940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb2628-7742-465e-affb-c1b7be5df87e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:45.388140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] MFA Rules not processed for user `a8f16be00ae64916b7f7e6416a0eca60`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:45.393008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:45.505374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:45.508179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:45.508633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:45.509670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:45.510335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] PATH_INFO: `/v3/projects/7310b6072d3f4cef9c8b028b579a20e1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:45.514364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7310b6072d3f4cef9c8b028b579a20e1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:45.519466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:45.547468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 904/1817] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:45.628595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7310b6072d3f4cef9c8b028b579a20e1', 'request_id': 'req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:45.648688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:45.650596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:45.688436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7310b6072d3f4cef9c8b028b579a20e1', 'request_id': 'req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:45.725212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7310b6072d3f4cef9c8b028b579a20e1', 'request_id': 'req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:45.734294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:45.773008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] The token cache is being invalidate because project 7310b6072d3f4cef9c8b028b579a20e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:45.773440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:45.774685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1cd12abb-989c-4055-b8ae-6f7861a2ff8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:45.776787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 914/1818] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:45 2022] DELETE /identity/v3/projects/7310b6072d3f4cef9c8b028b579a20e1 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:39:45.782945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d26051-7af5-42f8-836e-2b5e5de7e7b1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:45.783261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d26051-7af5-42f8-836e-2b5e5de7e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:45.783489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d26051-7af5-42f8-836e-2b5e5de7e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:45.810559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ba6d6-615e-4692-ac37-1b5677502df2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:45.842172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-39d26051-7af5-42f8-836e-2b5e5de7e7b1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:45.844639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-39d26051-7af5-42f8-836e-2b5e5de7e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:45.967080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:45.967080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:45.971830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:45.979642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:45.985914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:46.014988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 915/1819] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:46.016468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabbcee-bd24-436b-a39e-2c80f99a7f7d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.016868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabbcee-bd24-436b-a39e-2c80f99a7f7d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.017147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabbcee-bd24-436b-a39e-2c80f99a7f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.078455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-acabbcee-bd24-436b-a39e-2c80f99a7f7d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:46.084813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-acabbcee-bd24-436b-a39e-2c80f99a7f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:46.098737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:46.100759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:46.112821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 905/1820] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:39:46.113576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 916/1821] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:46.116192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:46.144882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f052f-209c-42c2-9544-a4e99d6c0aca service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:46.176211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:46.176861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.177145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.177421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.178126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:46.180009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:46.183843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:46.219894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 906/1822] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:46.227957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabbcee-bd24-436b-a39e-2c80f99a7f7d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:46.240897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabbcee-bd24-436b-a39e-2c80f99a7f7d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:46.246694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbcf50-38d0-4c2e-8e0e-cf676b7682e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:46.247387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbcf50-38d0-4c2e-8e0e-cf676b7682e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.248458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbcf50-38d0-4c2e-8e0e-cf676b7682e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.248458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbcf50-38d0-4c2e-8e0e-cf676b7682e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.249067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbcf50-38d0-4c2e-8e0e-cf676b7682e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:46.251460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbcf50-38d0-4c2e-8e0e-cf676b7682e2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:46.332699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 917/1823] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:46 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:46.334699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:46.398861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebdc2-6573-47f8-b169-1d2e93939713 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:46.492072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.492389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.492627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.535834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:46.551740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] MFA Rules not processed for user `2fdb46b5aa2c477d8abce5a1eb9fb68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:46.552873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:46.599053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:46.600469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.602261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.602596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.603386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:46.608505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:46.674270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 907/1824] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:46 2022] POST /identity/v3/users => generated 279 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:46.679047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:46.703824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 918/1825] 10.222.0.73 () {58 vars in 1015 bytes} [Wed Aug 24 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:46.723934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af2f5-4aee-41be-b7ed-e76bb368f564 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:46.724636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:46.726681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:46.747021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:46.748018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.748157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.748387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.749052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:46.750988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c3850-d1b8-49af-9283-512a3ae4140c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:46.751184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:46.772439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:46.775513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.776209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.778138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.813201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 908/1826] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:46.813506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:46.818287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:46.831100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:46.847192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36bcb7-cea6-4aa3-bf1e-6a9645db45f8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:46.862795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 919/1827] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:39:46.870519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:46.871187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.871466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.871795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:46.872573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:46.877026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:46.914323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:46.914508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 909/1828] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:46.952241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d5b58-9e92-41ef-b6a1-34ca87827020 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:46.975101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107b2e1-bb76-4497-ac61-a8b8e178fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:46.976188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107b2e1-bb76-4497-ac61-a8b8e178fc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:46.977451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107b2e1-bb76-4497-ac61-a8b8e178fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:46.979542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107b2e1-bb76-4497-ac61-a8b8e178fc86 admin admin] PATH_INFO: `/v3/projects/d84d367f215f4e5aa5297291e5f22c0e/users/ca52a98e8a3548a48c0ea89a70239e0c/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:47.021622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107b2e1-bb76-4497-ac61-a8b8e178fc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84d367f215f4e5aa5297291e5f22c0e, user_id=ca52a98e8a3548a48c0ea89a70239e0c, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:47.028561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107b2e1-bb76-4497-ac61-a8b8e178fc86 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:47.041212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:47.044115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:47.060014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 920/1829] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:46 2022] PUT /identity/v3/projects/d84d367f215f4e5aa5297291e5f22c0e/users/ca52a98e8a3548a48c0ea89a70239e0c/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:39:47.074748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ea41-beb0-4a7c-877a-c9e1b43d0695 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:47.075981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ea41-beb0-4a7c-877a-c9e1b43d0695 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:47.076622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878ea41-beb0-4a7c-877a-c9e1b43d0695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:47.090452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f14b20-9e2c-4558-a000-71d1d4b0aa55 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:47.136188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b878ea41-beb0-4a7c-877a-c9e1b43d0695 None None] MFA Rules not processed for user `ca52a98e8a3548a48c0ea89a70239e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:47.138179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b878ea41-beb0-4a7c-877a-c9e1b43d0695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:47.225764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:47.341998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:47.342887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:47.343370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:47.343812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] PATH_INFO: `/v3/users/867f53740127472282da3521ec3c7a3f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:47.345286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867f53740127472282da3521ec3c7a3f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:47.351506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:47.352007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 921/1830] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:47.353775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878ea41-beb0-4a7c-877a-c9e1b43d0695 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:47.401833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878ea41-beb0-4a7c-877a-c9e1b43d0695 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:47.418826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:47.419631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:47.420391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:47.420902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:47.421639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:47.423990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:47.481186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867f53740127472282da3521ec3c7a3f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:47.496905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 922/1831] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:47 2022] POST /identity/v3/projects => generated 357 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:47.500620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:47.506107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867f53740127472282da3521ec3c7a3f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:47.538056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867f53740127472282da3521ec3c7a3f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:47.562832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867f53740127472282da3521ec3c7a3f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:47.563998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-45456fbb-6d90-4af5-9f17-2b391c862120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867f53740127472282da3521ec3c7a3f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:47.585337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 910/1832] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:47 2022] DELETE /identity/v3/users/867f53740127472282da3521ec3c7a3f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:47.590559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:47.591290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:47.591814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:47.627757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:47.630946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:47.700453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170db188-db16-496c-8312-867bbdaec302 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:47.701027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:47.869130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:47.869841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:47.870141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:47.870446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:47.871431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:47.876781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:47.910516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 911/1833] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:47.931170 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 923/1834] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:47 2022] POST /identity/v3/users => generated 285 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:47.935509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:47.937107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:47.972581 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8ad9f-c672-401c-850f-3b71f2fe15b1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:47.997016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:47.998131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:48.001241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:48.001647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:48.003605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:48.005945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:48.012755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:48.016542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:48.062393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 912/1835] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:48.067292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:48.125984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc20a63-4d20-4472-870f-2ba582c86817 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:48.137087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:48.141174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:48.144764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:48.145553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] PATH_INFO: `/v3/projects/356d5481fb93403bbea5585c08f1800f/users/1067f05f2e10451c972602d6602f231c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:48.171591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:48.218154 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356d5481fb93403bbea5585c08f1800f, user_id=1067f05f2e10451c972602d6602f231c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:48.274665 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:48.284616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dda1-877f-46ba-b07a-6d163e78b15b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:48.318957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:48.328167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:48.330328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:48.332793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:48.412868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 913/1836] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:48 2022] PUT /identity/v3/projects/356d5481fb93403bbea5585c08f1800f/users/1067f05f2e10451c972602d6602f231c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:39:48.415770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:48.427311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:48.430502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:48.481423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 924/1837] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:48.571268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ee10-cba6-423d-b835-5dd423598e50 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:48.582628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b075c8d-3cbe-4b84-8d15-6587e1928d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:48.587723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b075c8d-3cbe-4b84-8d15-6587e1928d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:48.590686 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b075c8d-3cbe-4b84-8d15-6587e1928d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:48.591230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b075c8d-3cbe-4b84-8d15-6587e1928d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:48.592166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b075c8d-3cbe-4b84-8d15-6587e1928d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:48.598078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b075c8d-3cbe-4b84-8d15-6587e1928d8a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:48.622301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:48.623632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 914/1838] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:48.641591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f31e-8b19-4fce-b06c-0586313e9f5c service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:48.649243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:48.650331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:48.651384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:48.652391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] PATH_INFO: `/v3/projects/356d5481fb93403bbea5585c08f1800f/users/1067f05f2e10451c972602d6602f231c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:48.656465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356d5481fb93403bbea5585c08f1800f, user_id=1067f05f2e10451c972602d6602f231c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:48.662823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:48.729417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326e35-8ff7-4757-9093-28443cfbd3b9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:48.729706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326e35-8ff7-4757-9093-28443cfbd3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:48.730477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326e35-8ff7-4757-9093-28443cfbd3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:48.735272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 925/1839] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:48 2022] PUT /identity/v3/projects/356d5481fb93403bbea5585c08f1800f/users/1067f05f2e10451c972602d6602f231c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:48.853454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-23326e35-8ff7-4757-9093-28443cfbd3b9 None None] MFA Rules not processed for user `1067f05f2e10451c972602d6602f231c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:48.855386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-23326e35-8ff7-4757-9093-28443cfbd3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:49.043874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 915/1840] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:49.205047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:49.216430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:49.219217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c5b7-cbac-4ef0-921d-6dc9eee456eb None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:49.219624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c5b7-cbac-4ef0-921d-6dc9eee456eb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:49.219897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c5b7-cbac-4ef0-921d-6dc9eee456eb None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:49.223904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 916/1841] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:39:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:49.240631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:49.240923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:49.241198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:49.301944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:49.304311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:49.353404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:49.518066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea0c9e-5c2d-4e9a-a2fa-f35e626263d2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:49.531130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:49.531808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:49.532091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:49.532367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:49.568587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:49.573529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:49.590746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 917/1842] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:49.591758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:49.596972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:49.626811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 926/1843] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:49.662268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:49.664373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:49.720397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1322f7e-607b-4589-bed5-7dd629b7ef62 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:49.746671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:49.747679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:49.748062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:49.748629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:49.792293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:49.792381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:49.844114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 927/1844] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:39:49.851638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:49.859254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52772f88-6eb9-44d7-8a0b-705de9890f54 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:49.871024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:49.871780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:49.872037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:49.872284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] PATH_INFO: `/v3/projects/62ea4dff685045c7a6e30d9af608b79a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:49.878767 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ea4dff685045c7a6e30d9af608b79a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:49.880980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:49.903121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da05a4a-1baa-47ee-8d0f-c46a6fd9ce92 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:49.924944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:49.925258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:49.925603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:49.931250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:49.952882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:50.001054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ea4dff685045c7a6e30d9af608b79a', 'request_id': 'req-fd821e24-d0d5-418c-99e2-9800f9ad8b44'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.027839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ea4dff685045c7a6e30d9af608b79a', 'request_id': 'req-fd821e24-d0d5-418c-99e2-9800f9ad8b44'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.041532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ea4dff685045c7a6e30d9af608b79a', 'request_id': 'req-fd821e24-d0d5-418c-99e2-9800f9ad8b44'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.080968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] The token cache is being invalidate because project 62ea4dff685045c7a6e30d9af608b79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:50.081285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.083096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.088740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 918/1845] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:49 2022] DELETE /identity/v3/projects/62ea4dff685045c7a6e30d9af608b79a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:50.093871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:50.096312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:50.192209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:50.195560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:50.230530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 928/1846] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:50.235375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:50.240295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:50.241425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:50.287647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7396-e00a-4200-b327-f1d2421aedbc service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:50.321180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd821e24-d0d5-418c-99e2-9800f9ad8b44 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:50.337911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:50.338579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:50.338861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:50.340441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] PATH_INFO: `/v3/users/fdaeb2659a4c46f48728450309866e6c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:50.342673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdaeb2659a4c46f48728450309866e6c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:50.348245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:50.448142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09af5e-e9ee-405d-a945-94d95ee9f98f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:50.449145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09af5e-e9ee-405d-a945-94d95ee9f98f service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:50.449145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09af5e-e9ee-405d-a945-94d95ee9f98f service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:50.449478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09af5e-e9ee-405d-a945-94d95ee9f98f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:50.454862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ee09af5e-e9ee-405d-a945-94d95ee9f98f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:50.481205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdaeb2659a4c46f48728450309866e6c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.493516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:50.500156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdaeb2659a4c46f48728450309866e6c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.548030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdaeb2659a4c46f48728450309866e6c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.575723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdaeb2659a4c46f48728450309866e6c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.576766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdaeb2659a4c46f48728450309866e6c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:50.599779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09af5e-e9ee-405d-a945-94d95ee9f98f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:50.602911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09af5e-e9ee-405d-a945-94d95ee9f98f service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:50.618184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 919/1847] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:50 2022] DELETE /identity/v3/users/fdaeb2659a4c46f48728450309866e6c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:39:50.639544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 929/1848] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:51.326770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:51.328363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:51.464761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3caaa-66f2-44b1-ac82-5f8879d2c914 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:51.478104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:51.478969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:51.479409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:51.479854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] PATH_INFO: `/v3/users/5a6f4c0b91084852b309cd18ce6afb2e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:51.482213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6f4c0b91084852b309cd18ce6afb2e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:51.484455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:51.674489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6f4c0b91084852b309cd18ce6afb2e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:51.686802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6f4c0b91084852b309cd18ce6afb2e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:51.688698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:51.719732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6f4c0b91084852b309cd18ce6afb2e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:51.739977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6f4c0b91084852b309cd18ce6afb2e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:51.741243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6f4c0b91084852b309cd18ce6afb2e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:51.770135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 920/1849] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:51 2022] DELETE /identity/v3/users/5a6f4c0b91084852b309cd18ce6afb2e => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:51.771958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:51.772829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:51.773382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:51.821220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:51.823027 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:51.977612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 930/1850] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:51.994359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:51.996308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:52.192809 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825455d7-cf6a-491e-9155-cf925e864d98 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:52.200256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8899ab-3ab8-4998-8d36-4ff3e8408224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:52.203786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8899ab-3ab8-4998-8d36-4ff3e8408224 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:52.204605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8899ab-3ab8-4998-8d36-4ff3e8408224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:52.204803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8899ab-3ab8-4998-8d36-4ff3e8408224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:52.224099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8899ab-3ab8-4998-8d36-4ff3e8408224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:52.225687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8899ab-3ab8-4998-8d36-4ff3e8408224 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:52.244159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 921/1851] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:52.696626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:52.698887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:52.721487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409c122-0b1e-4cea-894d-8da0029ce490 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:52.733421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:52.734116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:52.734402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:52.734685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] PATH_INFO: `/v3/projects/92a15d66ac224459b4f337a562da396d` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:52.743440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a15d66ac224459b4f337a562da396d)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:52.764491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:52.927190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a15d66ac224459b4f337a562da396d', 'request_id': 'req-819d7461-d41a-4d76-8e6a-3a6079e66568'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:52.941977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a15d66ac224459b4f337a562da396d', 'request_id': 'req-819d7461-d41a-4d76-8e6a-3a6079e66568'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:52.952281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a15d66ac224459b4f337a562da396d', 'request_id': 'req-819d7461-d41a-4d76-8e6a-3a6079e66568'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:52.995880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] The token cache is being invalidate because project 92a15d66ac224459b4f337a562da396d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:52.998746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:53.001407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-819d7461-d41a-4d76-8e6a-3a6079e66568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:53.006148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 931/1852] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:52 2022] DELETE /identity/v3/projects/92a15d66ac224459b4f337a562da396d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:53.014587 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.015982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.016418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.054551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:53.056827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:53.238453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 922/1853] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:53.247736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d2d9-e0ba-433b-bb1d-903e5cd72ee4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.248047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d2d9-e0ba-433b-bb1d-903e5cd72ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.248317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d2d9-e0ba-433b-bb1d-903e5cd72ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.323255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7770d2d9-e0ba-433b-bb1d-903e5cd72ee4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:53.326199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7770d2d9-e0ba-433b-bb1d-903e5cd72ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:53.341061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:53.343143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:53.368329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 932/1854] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:53.381180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770d2d9-e0ba-433b-bb1d-903e5cd72ee4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:53.386039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423de866-550b-4c14-9492-ba6d93d871fd None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:53.409425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:53.410096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.410390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.410636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] PATH_INFO: `/v3/projects/eb937080d1704a198c7154ae0e706e72` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.417302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb937080d1704a198c7154ae0e706e72)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:53.421935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770d2d9-e0ba-433b-bb1d-903e5cd72ee4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:53.425343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:53.444493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:53.445144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.446777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.447063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.447763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:53.448068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:53.449745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:53.503296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 933/1855] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:53.505003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:53.538531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bac8-0f8c-4b91-94f5-4924b0d85301 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:53.558555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:53.559396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.559711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.564198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.568788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:53.575420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:53.597661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb937080d1704a198c7154ae0e706e72', 'request_id': 'req-2a01894b-4681-4166-ba58-a0e2da610018'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:53.620639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb937080d1704a198c7154ae0e706e72', 'request_id': 'req-2a01894b-4681-4166-ba58-a0e2da610018'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:53.640467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:53.640711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb937080d1704a198c7154ae0e706e72', 'request_id': 'req-2a01894b-4681-4166-ba58-a0e2da610018'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:53.667699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:53.678365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 934/1856] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:53 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:53.680621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:53.683336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] The token cache is being invalidate because project eb937080d1704a198c7154ae0e706e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:53.683755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:53.686232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:53.692426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 923/1857] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:53 2022] DELETE /identity/v3/projects/eb937080d1704a198c7154ae0e706e72 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:53.696997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:53.702690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:53.830838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af815d0-2294-4f60-97bf-a9d44c4fc81f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:53.837212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:53.837879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.839075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.839627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.840445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:53.842949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:53.879960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 935/1858] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:53 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:53.885597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:53.892592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:53.907821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01894b-4681-4166-ba58-a0e2da610018 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:53.916459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffe1ec-dae6-4007-9432-9f1bb71fe188 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:53.920795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:53.921707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.923350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.924302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] PATH_INFO: `/v3/users/51a1dffccead41eabea67a8991fbfa15` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.926486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:53.927322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a1dffccead41eabea67a8991fbfa15)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:53.928264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:53.930578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:53.931018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:53.931856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:53.935838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:53.936646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:53.971036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 936/1859] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:53.976397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:54.006301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc3d6b-bb04-4d34-8613-68a2fb8b4951 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:54.015348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:54.016655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:54.017202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:54.017771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:54.018612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:54.020464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:54.034071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 937/1860] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:54.038882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:54.051902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225affd-b49e-4ff2-a3a0-19839e9f6d3c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:54.059083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2760d-96c2-4f2f-8a68-2df23de16351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:54.060126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2760d-96c2-4f2f-8a68-2df23de16351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:54.060600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2760d-96c2-4f2f-8a68-2df23de16351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:54.061056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2760d-96c2-4f2f-8a68-2df23de16351 admin admin] PATH_INFO: `/v3/projects/7388c390ea3a4b25ae6d1d2f94695d51/users/45f20bdd108046dc830c7bdbea4b3b80/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:54.085471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a1dffccead41eabea67a8991fbfa15'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:54.091537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2760d-96c2-4f2f-8a68-2df23de16351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7388c390ea3a4b25ae6d1d2f94695d51, user_id=45f20bdd108046dc830c7bdbea4b3b80, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:54.097415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2760d-96c2-4f2f-8a68-2df23de16351 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:54.104909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a1dffccead41eabea67a8991fbfa15'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:54.146440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 938/1861] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:54 2022] PUT /identity/v3/projects/7388c390ea3a4b25ae6d1d2f94695d51/users/45f20bdd108046dc830c7bdbea4b3b80/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:54.157375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:54.157586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:54.157887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:54.169370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a1dffccead41eabea67a8991fbfa15'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:54.197159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a1dffccead41eabea67a8991fbfa15'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:54.199940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6082d69c-3444-4aca-b9e6-e4147ca865a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a1dffccead41eabea67a8991fbfa15'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:54.235606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 924/1862] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:53 2022] DELETE /identity/v3/users/51a1dffccead41eabea67a8991fbfa15 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:54.246970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] MFA Rules not processed for user `45f20bdd108046dc830c7bdbea4b3b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:54.258545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:54.457542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac1bf-fb94-4616-921a-db9297dabbe5 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:54.458124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac1bf-fb94-4616-921a-db9297dabbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:54.458602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fac1bf-fb94-4616-921a-db9297dabbe5 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:54.461195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 925/1863] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:39:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:39:54.486831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:54.487353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:54.487839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:54.523461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:54.524854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:54.637454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 939/1864] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:54.654205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:54.656167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:54.743495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 926/1865] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:39:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:39:54.764585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:54.798304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:54.804447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:54.842674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6229e79-3fff-4ab2-97a0-e71eaf30a622 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:54.864474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:54.866012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:54.866471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:54.866913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:54.907482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:54.918509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:54.941493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:54.943557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b00c0-5452-42ec-9c4d-1b64682d432b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:54.955731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a34c3-a5ac-44ea-9f8b-6d288cbf34f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a331472a0040d68824a2245bf3e716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:54.956402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a34c3-a5ac-44ea-9f8b-6d288cbf34f8 service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:54.956682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a34c3-a5ac-44ea-9f8b-6d288cbf34f8 service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:54.956954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a34c3-a5ac-44ea-9f8b-6d288cbf34f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:54.960841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 927/1866] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:54.974292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a34c3-a5ac-44ea-9f8b-6d288cbf34f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:54.976853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a34c3-a5ac-44ea-9f8b-6d288cbf34f8 service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:55.008492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 940/1867] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:39:55.280022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:55.282007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:55.510551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3fbb-442b-4ae8-abdd-eb223e1b0aec service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:55.518210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:55.519223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:55.519736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:55.520150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] PATH_INFO: `/v3/projects/13161b8deb65445b846e82fa8de0e117` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:55.521444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13161b8deb65445b846e82fa8de0e117)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:55.525553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:55.682044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13161b8deb65445b846e82fa8de0e117', 'request_id': 'req-9ff82f17-9f93-43f3-b891-ecdec9456b78'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:55.700024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13161b8deb65445b846e82fa8de0e117', 'request_id': 'req-9ff82f17-9f93-43f3-b891-ecdec9456b78'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:55.712765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13161b8deb65445b846e82fa8de0e117', 'request_id': 'req-9ff82f17-9f93-43f3-b891-ecdec9456b78'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:55.742448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] The token cache is being invalidate because project 13161b8deb65445b846e82fa8de0e117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:55.742448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:55.742448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ff82f17-9f93-43f3-b891-ecdec9456b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:55.751569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f78e8-062d-4a0f-bf0b-844530ddf55c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:55.751569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f78e8-062d-4a0f-bf0b-844530ddf55c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:55.751767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f78e8-062d-4a0f-bf0b-844530ddf55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:55.757147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 928/1868] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:55 2022] DELETE /identity/v3/projects/13161b8deb65445b846e82fa8de0e117 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:55.794461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-398f78e8-062d-4a0f-bf0b-844530ddf55c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:55.798082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-398f78e8-062d-4a0f-bf0b-844530ddf55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:55.963314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 941/1869] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:39:55.973834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aa3fe-66ff-4209-a31e-bd3d5d33f9c7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:55.974316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aa3fe-66ff-4209-a31e-bd3d5d33f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:55.974703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aa3fe-66ff-4209-a31e-bd3d5d33f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.073415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7b2aa3fe-66ff-4209-a31e-bd3d5d33f9c7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:56.077515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7b2aa3fe-66ff-4209-a31e-bd3d5d33f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:56.155505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 929/1870] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:56.160005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f78e8-062d-4a0f-bf0b-844530ddf55c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:56.178618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f78e8-062d-4a0f-bf0b-844530ddf55c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:56.188432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:56.190958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:56.191984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:56.192456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.193318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:56.194126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:56.197101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:56.222181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aa3fe-66ff-4209-a31e-bd3d5d33f9c7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:56.233930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 942/1871] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:39:56.237095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aa3fe-66ff-4209-a31e-bd3d5d33f9c7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:56.242768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:56.244151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:56.244913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:56.245392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.248415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:56.251315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:56.327087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:56.337918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 930/1872] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:56 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:56.342395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0cbf-2821-4b68-b95d-449e9b9abe6f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:56.423052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:56.424834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:56.425606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:56.426107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.427327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:56.430432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:56.468248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 943/1873] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:56 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:39:56.472937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:56.491730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a70b-d3f4-4aaf-9ed2-9d68eea4d9b6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:56.507728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:56.509333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:56.509831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:56.510441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.527663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:56.527663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:56.567747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 931/1874] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:56.570991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:56.590225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da52d84-70d9-47e7-9cb5-086bc3956275 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:56.602924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaf24d-5194-499d-9e28-b98a3a987958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:56.606481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaf24d-5194-499d-9e28-b98a3a987958 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:56.606481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaf24d-5194-499d-9e28-b98a3a987958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:56.606481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaf24d-5194-499d-9e28-b98a3a987958 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.606844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaf24d-5194-499d-9e28-b98a3a987958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:56.608521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaf24d-5194-499d-9e28-b98a3a987958 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:56.635900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 944/1875] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:56.637433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:56.659016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86211a-d175-455c-b118-a7eab3cd2a41 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:56.670506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:56.671189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:56.671469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:56.671869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] PATH_INFO: `/v3/projects/315b61dac78541d195650297e3274973/users/3fbe40aa2c284076bcab543e165eef1b/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.695330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=315b61dac78541d195650297e3274973, user_id=3fbe40aa2c284076bcab543e165eef1b, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:56.698485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:56.731570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 932/1876] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:56 2022] PUT /identity/v3/projects/315b61dac78541d195650297e3274973/users/3fbe40aa2c284076bcab543e165eef1b/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:56.742996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dfdb4-6914-4608-b485-c3f37b7f9299 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:56.743779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dfdb4-6914-4608-b485-c3f37b7f9299 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:56.744261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3dfdb4-6914-4608-b485-c3f37b7f9299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:56.799921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8e3dfdb4-6914-4608-b485-c3f37b7f9299 None None] MFA Rules not processed for user `3fbe40aa2c284076bcab543e165eef1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:56.801295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8e3dfdb4-6914-4608-b485-c3f37b7f9299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:56.806186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:56.902721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 945/1877] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:56.907226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:56.951195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:56.996862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dee7b-e0ab-4657-ae28-8e2af499a58c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.001999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.002654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.003077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.003361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.004042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.006089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:57.041658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 933/1878] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:56 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:39:57.045618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dfdb4-6914-4608-b485-c3f37b7f9299 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:57.062996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3dfdb4-6914-4608-b485-c3f37b7f9299 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.193480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.194173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.194479 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.194784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.196179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.198135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:57.252720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 946/1879] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:57 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:39:57.254045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:57.275482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ebd18-e04d-4bcf-89db-edb8c46a9afb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.282582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.284006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.284176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.284649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.285444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.288311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:57.301419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 934/1880] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:57.305875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:57.318817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249730f-7810-4dc5-ab14-0dda321935a7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.329026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.329775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.330028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.330305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] PATH_INFO: `/v3/projects/6a94a0cb6ec34c66bc876ef09b64a9e5/users/6a732a27e5c541bcb3b412879e5afdd8/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.356858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a94a0cb6ec34c66bc876ef09b64a9e5, user_id=6a732a27e5c541bcb3b412879e5afdd8, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.359965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:57.414357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 947/1881] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:57 2022] PUT /identity/v3/projects/6a94a0cb6ec34c66bc876ef09b64a9e5/users/6a732a27e5c541bcb3b412879e5afdd8/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:57.415077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:57.427318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4362c-e24e-4440-940d-226110fd68d0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.503511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ddf1a-18d6-4055-b45d-cb6267a70eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.504246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ddf1a-18d6-4055-b45d-cb6267a70eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.504640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ddf1a-18d6-4055-b45d-cb6267a70eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.504952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ddf1a-18d6-4055-b45d-cb6267a70eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.505631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ddf1a-18d6-4055-b45d-cb6267a70eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.516976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ddf1a-18d6-4055-b45d-cb6267a70eaf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:57.531629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 935/1882] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:39:57.535350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:57.548450 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86021c-eb44-475d-bef1-7f7dc51d9a1e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.553799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.554468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.554748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.555002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] PATH_INFO: `/v3/projects/6a94a0cb6ec34c66bc876ef09b64a9e5/users/6a732a27e5c541bcb3b412879e5afdd8/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.557068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a94a0cb6ec34c66bc876ef09b64a9e5, user_id=6a732a27e5c541bcb3b412879e5afdd8, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.560393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:57.573253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 948/1883] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:39:57 2022] PUT /identity/v3/projects/6a94a0cb6ec34c66bc876ef09b64a9e5/users/6a732a27e5c541bcb3b412879e5afdd8/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:57.587350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79060-598b-4a5d-835a-70cdd77b05df None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.587350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79060-598b-4a5d-835a-70cdd77b05df None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.588166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79060-598b-4a5d-835a-70cdd77b05df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.627670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-25a79060-598b-4a5d-835a-70cdd77b05df None None] MFA Rules not processed for user `6a732a27e5c541bcb3b412879e5afdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:57.628899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-25a79060-598b-4a5d-835a-70cdd77b05df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:57.729002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 936/1884] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:39:57.743277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:57.745020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:57.809928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dde17-3190-4525-801a-7bf315c5f4e8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.813671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e89d1-3b76-4446-a09f-618f4afc830d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.814267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e89d1-3b76-4446-a09f-618f4afc830d service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.814541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e89d1-3b76-4446-a09f-618f4afc830d service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.814810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e89d1-3b76-4446-a09f-618f4afc830d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.825588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e89d1-3b76-4446-a09f-618f4afc830d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.827074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e89d1-3b76-4446-a09f-618f4afc830d service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:57.833837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:57.838242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 949/1885] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:57.869677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a79060-598b-4a5d-835a-70cdd77b05df None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:57.892763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:57.939288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a79060-598b-4a5d-835a-70cdd77b05df None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:57.945154 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:57.945914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:57.946196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:57.946474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] PATH_INFO: `/v3/users/3fbe40aa2c284076bcab543e165eef1b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:57.947691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbe40aa2c284076bcab543e165eef1b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:57.950178 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:58.002109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbe40aa2c284076bcab543e165eef1b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.010241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbe40aa2c284076bcab543e165eef1b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.024447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbe40aa2c284076bcab543e165eef1b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.036948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbe40aa2c284076bcab543e165eef1b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.037683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbe40aa2c284076bcab543e165eef1b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.046845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 937/1886] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:57 2022] DELETE /identity/v3/users/3fbe40aa2c284076bcab543e165eef1b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:58.052860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:58.053430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:58.053430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:58.073517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:58.074872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:58.139615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 950/1887] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:39:58.150273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:58.151874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:58.242914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b16f0-0013-4acf-beb6-9f972c6efc31 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:58.248539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:58.249346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:58.249695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:58.250095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:58.260740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:58.262472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:58.273618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 938/1888] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:39:58.706566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:58.709090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:58.721424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bfc58-1d34-428f-9609-e4707c17c3ed None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:58.736818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:58.737649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:58.737931 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:58.738210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] PATH_INFO: `/v3/projects/315b61dac78541d195650297e3274973` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:58.739654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=315b61dac78541d195650297e3274973)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:58.741829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:58.825065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315b61dac78541d195650297e3274973', 'request_id': 'req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.831024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315b61dac78541d195650297e3274973', 'request_id': 'req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.837707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315b61dac78541d195650297e3274973', 'request_id': 'req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.852568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] The token cache is being invalidate because project 315b61dac78541d195650297e3274973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:58.852884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.853505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:58.855072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 951/1889] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:58 2022] DELETE /identity/v3/projects/315b61dac78541d195650297e3274973 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:58.859438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:58.869370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe760c7-abad-4395-9629-dcc9043ddbe8 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:58.917463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:58.938722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:58.939388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:58.939720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:58.940441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] PATH_INFO: `/v3/users/6a732a27e5c541bcb3b412879e5afdd8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:58.941263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a732a27e5c541bcb3b412879e5afdd8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:58.943448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:59.001662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a732a27e5c541bcb3b412879e5afdd8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.009692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a732a27e5c541bcb3b412879e5afdd8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.022313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a732a27e5c541bcb3b412879e5afdd8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.030967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a732a27e5c541bcb3b412879e5afdd8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.031635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3c62b25b-838e-4edb-8abf-12012341222e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a732a27e5c541bcb3b412879e5afdd8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.038083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 939/1890] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:39:58 2022] DELETE /identity/v3/users/6a732a27e5c541bcb3b412879e5afdd8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:59.347546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:59.349393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:59.364644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fca9a-93cb-44fe-aca4-0ed833529c7c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:59.444292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:59.444952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:59.445228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:59.445681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] PATH_INFO: `/v3/projects/6a94a0cb6ec34c66bc876ef09b64a9e5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:59.450448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a94a0cb6ec34c66bc876ef09b64a9e5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:59.452809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:59.507157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:59.536689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a94a0cb6ec34c66bc876ef09b64a9e5', 'request_id': 'req-a536f130-f028-4375-8ed9-58f871e059dc'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.545726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a94a0cb6ec34c66bc876ef09b64a9e5', 'request_id': 'req-a536f130-f028-4375-8ed9-58f871e059dc'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.555875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a94a0cb6ec34c66bc876ef09b64a9e5', 'request_id': 'req-a536f130-f028-4375-8ed9-58f871e059dc'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.574580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] The token cache is being invalidate because project 6a94a0cb6ec34c66bc876ef09b64a9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:39:59.575185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.576041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a536f130-f028-4375-8ed9-58f871e059dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:39:59.579654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 952/1891] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:39:59 2022] DELETE /identity/v3/projects/6a94a0cb6ec34c66bc876ef09b64a9e5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:39:59.582862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90165-ed5b-4ac0-a172-7b6d4b1d48e4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:59.583226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90165-ed5b-4ac0-a172-7b6d4b1d48e4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:59.583597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add90165-ed5b-4ac0-a172-7b6d4b1d48e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:59.604849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-add90165-ed5b-4ac0-a172-7b6d4b1d48e4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:59.606193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-add90165-ed5b-4ac0-a172-7b6d4b1d48e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:59.672748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 940/1892] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:59.681924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b0b5-5686-4871-8a1b-0e974d75cd9d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:59.682216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b0b5-5686-4871-8a1b-0e974d75cd9d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:59.682550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b0b5-5686-4871-8a1b-0e974d75cd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:59.704619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7a09b0b5-5686-4871-8a1b-0e974d75cd9d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:39:59.706068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7a09b0b5-5686-4871-8a1b-0e974d75cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:39:59.719039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 953/1893] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:39:59.723846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add90165-ed5b-4ac0-a172-7b6d4b1d48e4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:59.739683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add90165-ed5b-4ac0-a172-7b6d4b1d48e4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:59.745085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:59.748440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:59.749173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:59.749173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:59.750271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:39:59.750662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:59.752325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:59.766357 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 941/1894] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:39:59.770844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b0b5-5686-4871-8a1b-0e974d75cd9d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:59.786347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b0b5-5686-4871-8a1b-0e974d75cd9d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:59.795988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:59.796734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:59.797112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:59.798707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:59.799282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:39:59.807731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:39:59.855064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 954/1895] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:39:59 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:39:59.856360 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:39:59.867625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d97f4-bdfd-4948-8a0b-fe2697b7c46e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:39:59.960228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:39:59.995903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:39:59.997372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:39:59.997607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:39:59.997885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:39:59.998577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.003283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.039652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 942/1896] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:39:59 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:00.044048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.058039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd5254-80da-4e47-8b64-e18e896051d0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.064343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.065178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.065850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.066309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.067542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.070079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.083620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 955/1897] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:00.087835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.099688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d909f-3d3a-4db9-b1fe-2387b99cefda admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.107412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43432c3c-cb5b-42cb-b7df-c5af999f775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.108344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432c3c-cb5b-42cb-b7df-c5af999f775f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.108741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432c3c-cb5b-42cb-b7df-c5af999f775f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.109122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432c3c-cb5b-42cb-b7df-c5af999f775f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.110442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43432c3c-cb5b-42cb-b7df-c5af999f775f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.111531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43432c3c-cb5b-42cb-b7df-c5af999f775f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.131971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 943/1898] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:00.133551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.152788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a997d0a-f5ea-413a-97b1-e5c958ef28fd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.159558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.160312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.160590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.160854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] PATH_INFO: `/v3/projects/db3af8606f584e7991a24a73511a18fc/users/214d01f57b1047bc82dc7e4c2f1d0736/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.177103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3af8606f584e7991a24a73511a18fc, user_id=214d01f57b1047bc82dc7e4c2f1d0736, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.179860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.194671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 956/1899] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:00 2022] PUT /identity/v3/projects/db3af8606f584e7991a24a73511a18fc/users/214d01f57b1047bc82dc7e4c2f1d0736/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:00.205239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23884052-c733-483e-9408-cec0f12de491 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.205805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23884052-c733-483e-9408-cec0f12de491 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.206170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23884052-c733-483e-9408-cec0f12de491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.235967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-23884052-c733-483e-9408-cec0f12de491 None None] MFA Rules not processed for user `214d01f57b1047bc82dc7e4c2f1d0736`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:00.237233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-23884052-c733-483e-9408-cec0f12de491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:00.357031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 944/1900] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:00.363550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.460023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec47cb-3a40-425b-bfa8-2248fa80f687 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.466093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.466828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.467174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.467681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.468390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.471376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.522203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 957/1901] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:00 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:00.523338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23884052-c733-483e-9408-cec0f12de491 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.540081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23884052-c733-483e-9408-cec0f12de491 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.658248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.659196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.659656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.660068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.660903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.663778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.697533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 945/1902] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:00 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:00.699633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.712497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a44fb-87a7-4fd1-b117-0ebe6c3e889c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.717412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.718112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.718395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.718670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.719321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.721500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.732568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 958/1903] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:00.739139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.750220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858e38c-e88e-4777-82e3-6076e3767f57 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.755607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.756566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.756920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.757285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] PATH_INFO: `/v3/projects/8a396273b32641d3aaf769be79825cb7/users/147c67903c16486b94f41d0892f49578/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.779658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a396273b32641d3aaf769be79825cb7, user_id=147c67903c16486b94f41d0892f49578, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.782315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.799911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 946/1904] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:00 2022] PUT /identity/v3/projects/8a396273b32641d3aaf769be79825cb7/users/147c67903c16486b94f41d0892f49578/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:00.804295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.819087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a5c5e-9eb2-4e3d-8698-d609dceccaa6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.843073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:00.888065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743bc81-9a7f-418a-8a1c-9ff29799e67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.889002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743bc81-9a7f-418a-8a1c-9ff29799e67d admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.889282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743bc81-9a7f-418a-8a1c-9ff29799e67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.889552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743bc81-9a7f-418a-8a1c-9ff29799e67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.890776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743bc81-9a7f-418a-8a1c-9ff29799e67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.892495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743bc81-9a7f-418a-8a1c-9ff29799e67d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.904330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 959/1905] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:00.908419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:00.919942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cff708-b2a5-4cc5-92aa-e2c9cad5da14 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:00.925474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:00.926343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.926719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.927101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] PATH_INFO: `/v3/projects/8a396273b32641d3aaf769be79825cb7/users/147c67903c16486b94f41d0892f49578/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:00.929302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a396273b32641d3aaf769be79825cb7, user_id=147c67903c16486b94f41d0892f49578, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:00.932183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:00.950294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 947/1906] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:00 2022] PUT /identity/v3/projects/8a396273b32641d3aaf769be79825cb7/users/147c67903c16486b94f41d0892f49578/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:00.964217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db76d3-581d-4662-baba-64fac5d52f83 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:00.964788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db76d3-581d-4662-baba-64fac5d52f83 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:00.965160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db76d3-581d-4662-baba-64fac5d52f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:01.002547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-48db76d3-581d-4662-baba-64fac5d52f83 None None] MFA Rules not processed for user `147c67903c16486b94f41d0892f49578`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:01.003819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-48db76d3-581d-4662-baba-64fac5d52f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:01.101842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 960/1907] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:01.117423 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:01.119901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:01.134187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:01.201731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa0d3-e2e7-45b6-a708-1c3463d4c1b8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:01.210258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:01.211008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:01.211391 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:01.211798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:01.229991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:01.237333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:01.249728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 948/1908] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:01.959130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db76d3-581d-4662-baba-64fac5d52f83 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:01.970362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db76d3-581d-4662-baba-64fac5d52f83 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:01.977516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '147c67903c16486b94f41d0892f49578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a396273b32641d3aaf769be79825cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:01.978295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:01.978690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:01.979050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:01.979874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:01.980527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:01.982740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:01.996397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 961/1909] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:02.001528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:02.011070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ba0d-cbbc-46b8-97f6-16234182d085 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:02.016397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '147c67903c16486b94f41d0892f49578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a396273b32641d3aaf769be79825cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:02.017001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:02.017284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:02.017709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:02.018379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:02.020365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:02.056860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 949/1910] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:02 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:02.061917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:02.077203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e4c4-2a58-4926-bd0e-bbf7ec7d60d8 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:02.142091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '147c67903c16486b94f41d0892f49578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a396273b32641d3aaf769be79825cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:02.142713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:02.143026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:02.143303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:02.143984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:02.144308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:02.145952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:02.158899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 962/1911] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:02.210336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:02.222654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e76043-cd26-438f-8180-0bf3a68b5123 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:02.228458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '147c67903c16486b94f41d0892f49578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a396273b32641d3aaf769be79825cb7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:02.229102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:02.229388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:02.229663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] PATH_INFO: `/v3/projects/79d32cb9192b46cb86ac59a01f2afc39` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:02.231422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorizing `identity:delete_project(project_id=79d32cb9192b46cb86ac59a01f2afc39)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:02.233385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:02.288103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d32cb9192b46cb86ac59a01f2afc39', 'request_id': 'req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:02.305653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d32cb9192b46cb86ac59a01f2afc39', 'request_id': 'req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:02.310252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d32cb9192b46cb86ac59a01f2afc39', 'request_id': 'req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:02.330705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] The token cache is being invalidate because project 79d32cb9192b46cb86ac59a01f2afc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:02.331002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:02.331741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6d7e5c94-3344-463b-886f-cc8d86d8e3e6 tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:02.336116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 950/1912] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:02 2022] DELETE /identity/v3/projects/79d32cb9192b46cb86ac59a01f2afc39 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:02.598610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:02.601620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:02.688747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:02.762425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7496ce-66fd-4d69-9afe-53f034fe43fd tempest-VolumeQuotaClassesTest-2119128238 tempest-VolumeQuotaClassesTest-2119128238-project-admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:02.872481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:02.873398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:02.873846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:02.874284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] PATH_INFO: `/v3/users/214d01f57b1047bc82dc7e4c2f1d0736` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:02.875735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214d01f57b1047bc82dc7e4c2f1d0736)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:02.877863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:03.024335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214d01f57b1047bc82dc7e4c2f1d0736'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:03.025054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214d01f57b1047bc82dc7e4c2f1d0736'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:03.041168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214d01f57b1047bc82dc7e4c2f1d0736'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:03.043027 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214d01f57b1047bc82dc7e4c2f1d0736'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:03.061983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-5ff697ab-b375-40f0-ba95-3dfb65ea7764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214d01f57b1047bc82dc7e4c2f1d0736'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:03.076554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338b6a-141b-4db7-9e60-fe11acee921b None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:03.077011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338b6a-141b-4db7-9e60-fe11acee921b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:03.077444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338b6a-141b-4db7-9e60-fe11acee921b None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:03.079557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 951/1913] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:40:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:40:03.099610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:03.100156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:03.100584 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:03.118272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 963/1914] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:02 2022] DELETE /identity/v3/users/214d01f57b1047bc82dc7e4c2f1d0736 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:03.124068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:03.124452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:03.124857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:03.128715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:03.149410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:03.178476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:03.181924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:03.371758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:03.400697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 964/1915] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:03.404883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:03.406326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:03.418650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 952/1916] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:03.447081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:03.448602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:03.459864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:03.469403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01f79f-9e33-47ad-a80c-89f98968b1bf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:03.477903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:03.478670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:03.479199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:03.479622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:03.493408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81f685-8f56-484b-958d-8914fa21aa75 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:03.495107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:03.497878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:03.500499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:03.501360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:03.501639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:03.501961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:03.517061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:03.518880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:03.522500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 953/1917] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:03.534526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 965/1918] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:03.984535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:03.985895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:04.022794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac324d9-7838-47dc-9f17-503f85ea9539 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:04.031911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:04.032574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:04.032992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:04.033151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] PATH_INFO: `/v3/projects/db3af8606f584e7991a24a73511a18fc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:04.037450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3af8606f584e7991a24a73511a18fc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:04.039405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:04.118085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3af8606f584e7991a24a73511a18fc', 'request_id': 'req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.135221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3af8606f584e7991a24a73511a18fc', 'request_id': 'req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.148730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3af8606f584e7991a24a73511a18fc', 'request_id': 'req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.167715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] The token cache is being invalidate because project db3af8606f584e7991a24a73511a18fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:04.168640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.170761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.176483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 954/1919] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:03 2022] DELETE /identity/v3/projects/db3af8606f584e7991a24a73511a18fc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:04.180504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:04.197904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26f3d-f0ca-4256-a1cd-27bc067efb71 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:04.317969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:04.319001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:04.319469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:04.319778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] PATH_INFO: `/v3/users/147c67903c16486b94f41d0892f49578` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:04.321370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147c67903c16486b94f41d0892f49578)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:04.323713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:04.404505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147c67903c16486b94f41d0892f49578'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.405403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147c67903c16486b94f41d0892f49578'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.417121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147c67903c16486b94f41d0892f49578'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.417985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147c67903c16486b94f41d0892f49578'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.431116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-05332632-de72-4556-8021-0d61632704b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147c67903c16486b94f41d0892f49578'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.464230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 966/1920] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:04 2022] DELETE /identity/v3/users/147c67903c16486b94f41d0892f49578 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:04.779942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:04.781795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:04.797715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e799c-f4ff-483f-ac73-1ec0b2399b6e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:04.872837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:04.873717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:04.873957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:04.874286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] PATH_INFO: `/v3/projects/8a396273b32641d3aaf769be79825cb7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:04.875482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a396273b32641d3aaf769be79825cb7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:04.877540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:04.942387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a396273b32641d3aaf769be79825cb7', 'request_id': 'req-e61c96d2-9862-450c-bf18-beb3b1a3f118'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.958605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a396273b32641d3aaf769be79825cb7', 'request_id': 'req-e61c96d2-9862-450c-bf18-beb3b1a3f118'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.970336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a396273b32641d3aaf769be79825cb7', 'request_id': 'req-e61c96d2-9862-450c-bf18-beb3b1a3f118'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.985705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] The token cache is being invalidate because project 8a396273b32641d3aaf769be79825cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:04.986290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.987132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e61c96d2-9862-450c-bf18-beb3b1a3f118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:04.989864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 955/1921] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:04 2022] DELETE /identity/v3/projects/8a396273b32641d3aaf769be79825cb7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:04.994879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f775e-6215-45e6-bf68-065e57ded910 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:04.995305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f775e-6215-45e6-bf68-065e57ded910 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:04.995622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f775e-6215-45e6-bf68-065e57ded910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.024560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f57f775e-6215-45e6-bf68-065e57ded910 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:05.025963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f57f775e-6215-45e6-bf68-065e57ded910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:05.056514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:05.162147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 967/1922] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:05.172468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e521c7-2858-4606-a42d-be9a5d002561 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.173014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e521c7-2858-4606-a42d-be9a5d002561 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.173192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e521c7-2858-4606-a42d-be9a5d002561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.186416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:05.202801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-46e521c7-2858-4606-a42d-be9a5d002561 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:05.204735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-46e521c7-2858-4606-a42d-be9a5d002561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:05.214442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 956/1923] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:05.223988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f775e-6215-45e6-bf68-065e57ded910 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:05.229575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f775e-6215-45e6-bf68-065e57ded910 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:05.235107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:05.235807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.236421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.236421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.236934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:05.237244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:05.238861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:05.251434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 968/1924] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:05.256250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e521c7-2858-4606-a42d-be9a5d002561 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:05.268018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e521c7-2858-4606-a42d-be9a5d002561 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:05.273233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:05.273794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.274076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.274351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.274986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:05.276942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:05.325646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 957/1925] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:05 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:05.326845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:05.337812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51e9c-7a15-4543-9f2c-571f860b26f0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:05.406250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:05.406872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.407152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.407422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.408284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:05.410101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:05.432367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 969/1926] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:05 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:05.437171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:05.448043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de0e91-b094-4b99-866f-11b98271b5e5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:05.453312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:05.453926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.454207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.454479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.455141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:05.457361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:05.470677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 958/1927] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:05.474962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:05.486765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e80f15-9044-4383-8e8d-8c270fed1cb5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:05.491378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0766-1c7f-4769-8e51-0fd3563b6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:05.492030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0766-1c7f-4769-8e51-0fd3563b6173 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.492309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0766-1c7f-4769-8e51-0fd3563b6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.492581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0766-1c7f-4769-8e51-0fd3563b6173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.493224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0766-1c7f-4769-8e51-0fd3563b6173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:05.494822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e0766-1c7f-4769-8e51-0fd3563b6173 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:05.511310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 970/1928] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:05.512709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:05.533078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55ef91-901a-4dbd-bcc0-3204091dc01a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:05.539429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:05.540432 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.541027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.541608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] PATH_INFO: `/v3/projects/9248b46d285e4499aae73438b5442db0/users/fa4ab29a210340cc93a39f2e76e9c57b/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.560939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9248b46d285e4499aae73438b5442db0, user_id=fa4ab29a210340cc93a39f2e76e9c57b, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:05.563712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:05.593666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 959/1929] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:05 2022] PUT /identity/v3/projects/9248b46d285e4499aae73438b5442db0/users/fa4ab29a210340cc93a39f2e76e9c57b/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:05.598082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69dafc-b576-4b5f-b30c-7f271afd78f8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.598467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69dafc-b576-4b5f-b30c-7f271afd78f8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.598840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69dafc-b576-4b5f-b30c-7f271afd78f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.655800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ee69dafc-b576-4b5f-b30c-7f271afd78f8 None None] MFA Rules not processed for user `fa4ab29a210340cc93a39f2e76e9c57b`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:05.655800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ee69dafc-b576-4b5f-b30c-7f271afd78f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:05.799553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 971/1930] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:05.804596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:05.925051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c9c4-ef31-415f-a19e-3c89993b0b65 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:05.932931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:05.934128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:05.934639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:05.935131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:05.936344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:05.938958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.020877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 960/1931] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:05 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:06.035722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69dafc-b576-4b5f-b30c-7f271afd78f8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.048682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69dafc-b576-4b5f-b30c-7f271afd78f8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.069420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:06.145516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.147911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.148300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.148633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.151118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.153410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.165045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.168916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:06.187319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c456-121d-4bde-bd7e-e5b2574237b3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.191643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 972/1932] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:06 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:06.194473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.195330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.196016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.196479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.197059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] PATH_INFO: `/v3/users/6bc5e47536864552908ba552c0f57a36` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.198419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc5e47536864552908ba552c0f57a36)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.213030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.213111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4453d-80d0-4359-a252-185176b8a8ea admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.213570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.213854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.214141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.214427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.215465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.216982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.227524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 973/1933] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:06.231330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.243015 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84879d-7db9-4eff-9fa0-f2c0c82a890e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.248652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.249643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.249996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.250161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.250841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.252583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.269435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 974/1934] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:06.269638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc5e47536864552908ba552c0f57a36'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:06.271216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.276158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc5e47536864552908ba552c0f57a36'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:06.283249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dae46-ed5f-46b2-91a6-8b0081204d8b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.288275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7be7e-cf23-4962-ab50-c24690fe533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.288929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7be7e-cf23-4962-ab50-c24690fe533d admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.289075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc5e47536864552908ba552c0f57a36'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:06.289210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7be7e-cf23-4962-ab50-c24690fe533d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.289478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7be7e-cf23-4962-ab50-c24690fe533d admin admin] PATH_INFO: `/v3/projects/6e5ec14979ed476cb6fe325d0cf141b5/users/5bdc485902684410bda3ad5ac1638530/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.297292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc5e47536864552908ba552c0f57a36'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:06.297961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-64573eff-7dd6-4347-8da4-da452a0bc377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc5e47536864552908ba552c0f57a36'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:06.299517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:06.306980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7be7e-cf23-4962-ab50-c24690fe533d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5ec14979ed476cb6fe325d0cf141b5, user_id=5bdc485902684410bda3ad5ac1638530, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.309835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 961/1935] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:06 2022] DELETE /identity/v3/users/6bc5e47536864552908ba552c0f57a36 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:06.310468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7be7e-cf23-4962-ab50-c24690fe533d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.314756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.314945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.315114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.325634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 975/1936] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:06 2022] PUT /identity/v3/projects/6e5ec14979ed476cb6fe325d0cf141b5/users/5bdc485902684410bda3ad5ac1638530/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:06.336823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.337108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.337381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.338476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:06.339785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:06.368973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] MFA Rules not processed for user `5bdc485902684410bda3ad5ac1638530`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:06.370184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:06.406360 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 962/1937] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:06.418894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.420454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:06.448084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 976/1938] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:06.453038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.454397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:06.468373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0d65b-4ed8-4e4e-a28d-64c914ebdff7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.475301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.475952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.476229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.476501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.477138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.479541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.485390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bda75-909b-4103-9902-0bae0f305c59 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.489623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.490538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.490911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.491199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.502944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.504417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.512745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 977/1939] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:06 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:06.514679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.517508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 963/1940] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:06.540675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:06.601611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e52d0-dcdf-4ca5-8b19-b6cb66d888ec admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.607077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.607745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.608024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.608333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.609021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.611232 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.650745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 978/1941] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:06 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:06.650939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.663455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b06787-fb12-4462-b048-1f9fb0681a01 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.670299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.671524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.672151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.672679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.673560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.676817 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.702845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 964/1942] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:06.707072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.722028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b62b9-a909-43cb-a9b6-8f0b66ae9729 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.735214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.735214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.735214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.735214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] PATH_INFO: `/v3/projects/36bb29b5bf6f43599c546468b5a88edd/users/846f574486304516841c813fc68830ec/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.752406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bb29b5bf6f43599c546468b5a88edd, user_id=846f574486304516841c813fc68830ec, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.755253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.772338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 979/1943] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:06 2022] PUT /identity/v3/projects/36bb29b5bf6f43599c546468b5a88edd/users/846f574486304516841c813fc68830ec/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:06.776668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.787427 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c140d-e082-4663-8b6c-c39519fa25c7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.860756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfc646-7c6a-4a2c-bd9c-d0a3bb893950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.861379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc646-7c6a-4a2c-bd9c-d0a3bb893950 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.861766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc646-7c6a-4a2c-bd9c-d0a3bb893950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.862040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfc646-7c6a-4a2c-bd9c-d0a3bb893950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.862702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfc646-7c6a-4a2c-bd9c-d0a3bb893950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.864518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfc646-7c6a-4a2c-bd9c-d0a3bb893950 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.877554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 965/1944] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:06.881539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:06.893339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b7fda-ae42-48c3-b957-35be0e252295 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:06.898085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:06.898788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.899068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.899341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] PATH_INFO: `/v3/projects/36bb29b5bf6f43599c546468b5a88edd/users/846f574486304516841c813fc68830ec/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.901299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bb29b5bf6f43599c546468b5a88edd, user_id=846f574486304516841c813fc68830ec, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:06.904271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:06.915345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 980/1945] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:06 2022] PUT /identity/v3/projects/36bb29b5bf6f43599c546468b5a88edd/users/846f574486304516841c813fc68830ec/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:06.925669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:06.926055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:06.926332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:06.959494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] MFA Rules not processed for user `846f574486304516841c813fc68830ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:06.959494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:06.973141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:07.039380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 966/1946] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:07.052052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:07.054650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:07.100033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:07.101653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:07.178548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800a67b-14fa-4b46-a448-c016fc6a5f14 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:07.182686 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:07.184397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:07.184564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:07.184825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:07.200622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8734e-dbe6-4b43-a8d1-77e009083171 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:07.201076 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:07.203152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:07.205380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:07.206174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:07.206497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:07.206835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] PATH_INFO: `/v3/projects/cb6c81624fff4bdf8a2745578486582c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:07.208224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6c81624fff4bdf8a2745578486582c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:07.210974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:07.214443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 981/1947] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:07.291993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6c81624fff4bdf8a2745578486582c', 'request_id': 'req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.306758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6c81624fff4bdf8a2745578486582c', 'request_id': 'req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.316937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6c81624fff4bdf8a2745578486582c', 'request_id': 'req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.334530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] The token cache is being invalidate because project cb6c81624fff4bdf8a2745578486582c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:07.335344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.336199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.338687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 967/1948] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:07 2022] DELETE /identity/v3/projects/cb6c81624fff4bdf8a2745578486582c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:07.342766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:07.365072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210982f5-6251-4ee3-a6d0-eaa9baeecfbc service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:07.469637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:07.470340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:07.474436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:07.474436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] PATH_INFO: `/v3/users/a8f16be00ae64916b7f7e6416a0eca60` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:07.474436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f16be00ae64916b7f7e6416a0eca60)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:07.474923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:07.509986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:07.522275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:07.524563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:07.547087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f16be00ae64916b7f7e6416a0eca60'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.547799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f16be00ae64916b7f7e6416a0eca60'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.556299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f16be00ae64916b7f7e6416a0eca60'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.557085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f16be00ae64916b7f7e6416a0eca60'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.568491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f16be00ae64916b7f7e6416a0eca60'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:07.586125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:07.593124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 982/1949] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:07 2022] DELETE /identity/v3/users/a8f16be00ae64916b7f7e6416a0eca60 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:07.599668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb60e8-a6fa-44f7-9ac2-7de1d5e3bb02 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:07.693014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6576-d9c8-4e80-984e-85d73bb52978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:07.694058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6576-d9c8-4e80-984e-85d73bb52978 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:07.694466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6576-d9c8-4e80-984e-85d73bb52978 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:07.694897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6576-d9c8-4e80-984e-85d73bb52978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:07.700035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6bcc6576-d9c8-4e80-984e-85d73bb52978 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:07.804137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6576-d9c8-4e80-984e-85d73bb52978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:07.805799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6576-d9c8-4e80-984e-85d73bb52978 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:07.822246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 968/1950] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:07.969178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:07.974078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:08.094656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a86df-306b-40bc-b3ec-08861294a3d6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:08.101467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:08.102197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.102568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.102949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] PATH_INFO: `/v3/projects/efd7f65698f94df2b6eab3aa15ff3e76` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.104226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd7f65698f94df2b6eab3aa15ff3e76)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:08.106866 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:08.169767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd7f65698f94df2b6eab3aa15ff3e76', 'request_id': 'req-f44fb670-c622-474c-bd08-c68cdff1881e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:08.177381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd7f65698f94df2b6eab3aa15ff3e76', 'request_id': 'req-f44fb670-c622-474c-bd08-c68cdff1881e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:08.189788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd7f65698f94df2b6eab3aa15ff3e76', 'request_id': 'req-f44fb670-c622-474c-bd08-c68cdff1881e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:08.213527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] The token cache is being invalidate because project efd7f65698f94df2b6eab3aa15ff3e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:08.213922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:08.215286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f44fb670-c622-474c-bd08-c68cdff1881e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:08.219078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 983/1951] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:07 2022] DELETE /identity/v3/projects/efd7f65698f94df2b6eab3aa15ff3e76 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:08.224387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45bd4f-f880-40f6-8119-80ca4ba18ccf None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.224863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45bd4f-f880-40f6-8119-80ca4ba18ccf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.224863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45bd4f-f880-40f6-8119-80ca4ba18ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.252023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7c45bd4f-f880-40f6-8119-80ca4ba18ccf None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:08.254016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7c45bd4f-f880-40f6-8119-80ca4ba18ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:08.370395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 969/1952] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:08.379261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a00f6-3e53-4ace-98be-78330f00acd3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.379762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a00f6-3e53-4ace-98be-78330f00acd3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.379924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a00f6-3e53-4ace-98be-78330f00acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.421772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-266a00f6-3e53-4ace-98be-78330f00acd3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:08.423255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-266a00f6-3e53-4ace-98be-78330f00acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:08.432215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 984/1953] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:08.437788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45bd4f-f880-40f6-8119-80ca4ba18ccf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:08.448577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45bd4f-f880-40f6-8119-80ca4ba18ccf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:08.454127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:08.454748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.455047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.455333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.456067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:08.456372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:08.458099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:08.470604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 970/1954] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:08.475183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a00f6-3e53-4ace-98be-78330f00acd3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:08.485516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a00f6-3e53-4ace-98be-78330f00acd3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:08.490298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:08.490936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.491205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.491474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.492200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:08.494221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:08.516114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:08.525842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 985/1955] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:08 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:08.530115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:08.540638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1243-04e5-4ee5-8b1a-d28a549e8092 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:08.595271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:08.627164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:08.628095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.628428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.628975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.629516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:08.632170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:08.659999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 971/1956] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:08 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:08.664778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:08.676089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea5248-6b54-41ab-9cb4-0c092d21c40e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:08.681977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:08.682883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.683283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.683983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.685197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:08.687215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:08.699639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 986/1957] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:08.704171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:08.718969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11575dc4-e6e3-4022-be1c-d519abdb08a4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:08.724443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e80b23-333b-4dc1-87af-e3370d3320c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:08.725064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80b23-333b-4dc1-87af-e3370d3320c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.725453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80b23-333b-4dc1-87af-e3370d3320c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.725881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80b23-333b-4dc1-87af-e3370d3320c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.726641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e80b23-333b-4dc1-87af-e3370d3320c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:08.728500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e80b23-333b-4dc1-87af-e3370d3320c6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:08.742030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 972/1958] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:08.747140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:08.758434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadce7e4-4078-400a-bc2c-5cfc9b152354 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:08.767637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:08.769183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.769183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.769349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] PATH_INFO: `/v3/projects/5f77c2640fa34a3ca373385645a25828/users/42b6f4e9cab64ea4857f058a94fa323d/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.786198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f77c2640fa34a3ca373385645a25828, user_id=42b6f4e9cab64ea4857f058a94fa323d, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:08.789026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:08.806141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 987/1959] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:08 2022] PUT /identity/v3/projects/5f77c2640fa34a3ca373385645a25828/users/42b6f4e9cab64ea4857f058a94fa323d/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:08.817166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c247-b3f7-4c9d-8ff3-df69c8b0b7d3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:08.817453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c247-b3f7-4c9d-8ff3-df69c8b0b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:08.817736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1c247-b3f7-4c9d-8ff3-df69c8b0b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:08.855094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f2a1c247-b3f7-4c9d-8ff3-df69c8b0b7d3 None None] MFA Rules not processed for user `42b6f4e9cab64ea4857f058a94fa323d`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:08.855883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f2a1c247-b3f7-4c9d-8ff3-df69c8b0b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:08.957897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 973/1960] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:08.958830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.054186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d319-03f3-44c4-99ce-ec34c911331b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:09.077833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:09.078495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.078495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.078884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.079854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:09.094109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:09.146010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 988/1961] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:08 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:09.147752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1c247-b3f7-4c9d-8ff3-df69c8b0b7d3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.162770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1c247-b3f7-4c9d-8ff3-df69c8b0b7d3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:09.245802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:09.250588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.250881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.253411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.254258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:09.261763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:09.294766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 974/1962] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:09 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:09.296357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.315181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b1b5-1a1a-4950-a687-c6d0bd093668 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:09.324648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:09.327198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.331151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.331549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.332359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:09.334427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:09.338413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.340820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:09.364897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe592e7-5547-4da7-b45f-4c1ba2814cc4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:09.373363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 989/1963] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:09.375219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.381827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:09.382494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.383106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.383402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] PATH_INFO: `/v3/users/ca52a98e8a3548a48c0ea89a70239e0c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.385881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca52a98e8a3548a48c0ea89a70239e0c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:09.389659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:09.398082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10077f4-bd3d-4af2-a8c8-29ce357503cc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:09.413290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:09.414142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.415814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.416633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] PATH_INFO: `/v3/projects/13d81db9fcbb416cb87f3ed0a9a0e546/users/1ad68a31408c4e48b8655e5938f92111/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.485786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d81db9fcbb416cb87f3ed0a9a0e546, user_id=1ad68a31408c4e48b8655e5938f92111, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:09.493789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:09.501688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:09.535367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca52a98e8a3548a48c0ea89a70239e0c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:09.540701 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 990/1964] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:09 2022] PUT /identity/v3/projects/13d81db9fcbb416cb87f3ed0a9a0e546/users/1ad68a31408c4e48b8655e5938f92111/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:09.548578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.567874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca52a98e8a3548a48c0ea89a70239e0c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:09.607837 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca52a98e8a3548a48c0ea89a70239e0c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:09.628561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca52a98e8a3548a48c0ea89a70239e0c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:09.629779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e5f6f75f-aa55-4ed6-a179-da31bb7aaeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca52a98e8a3548a48c0ea89a70239e0c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:09.663297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 975/1965] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:09 2022] DELETE /identity/v3/users/ca52a98e8a3548a48c0ea89a70239e0c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:09.670303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.670907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.671371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.702200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08ea01-dc04-4639-b2f6-78efb8bc84d0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:09.734367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:09.734880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:09.735701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:09.800622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:09.801369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.801891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.803448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.804796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:09.806664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:09.830924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 991/1966] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:09.836717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.838039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:09.865476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8ab51-9fbf-4f59-a297-c09e1d700eb6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:09.873414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416e80-793c-4b94-a78e-08ea1580afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:09.875011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416e80-793c-4b94-a78e-08ea1580afd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.875689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416e80-793c-4b94-a78e-08ea1580afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.877122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416e80-793c-4b94-a78e-08ea1580afd1 admin admin] PATH_INFO: `/v3/projects/13d81db9fcbb416cb87f3ed0a9a0e546/users/1ad68a31408c4e48b8655e5938f92111/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:09.881477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f416e80-793c-4b94-a78e-08ea1580afd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d81db9fcbb416cb87f3ed0a9a0e546, user_id=1ad68a31408c4e48b8655e5938f92111, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:09.888378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f416e80-793c-4b94-a78e-08ea1580afd1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:09.904982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 976/1967] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:09.925880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 992/1968] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:09 2022] PUT /identity/v3/projects/13d81db9fcbb416cb87f3ed0a9a0e546/users/1ad68a31408c4e48b8655e5938f92111/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:09.940143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:09.941828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:09.945981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:09.946257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:09.946535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:10.007249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] MFA Rules not processed for user `1ad68a31408c4e48b8655e5938f92111`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:10.008702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:10.034000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacfe8a-d299-405b-82fc-9c09f5a5d9c8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:10.137061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:10.138006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:10.138289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:10.138567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:10.161918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 993/1969] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:10.181420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:10.256312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:10.258897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:10.262613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:10.266263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:10.281723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 977/1970] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:10.334543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c1c61-a5a3-4473-9fda-eb88e1232f71 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:10.338447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:10.339179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:10.339600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:10.340115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:10.350622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:10.352225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:10.364309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 994/1971] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:10.484494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:10.495439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e7814-ae6e-42ff-8bef-235d9f3a47bc service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:10.500666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:10.501719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:10.502125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:10.502408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:10.504670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:10.619380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:10.621540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:10.635070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 978/1972] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:11.022640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:11.024831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:11.078847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b214c04-3a43-43cd-815d-65488d1767f7 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:11.097363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:11.098757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:11.098757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:11.098757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] PATH_INFO: `/v3/projects/d84d367f215f4e5aa5297291e5f22c0e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:11.112552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84d367f215f4e5aa5297291e5f22c0e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:11.112552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:11.169689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:11.207047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84d367f215f4e5aa5297291e5f22c0e', 'request_id': 'req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.214026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84d367f215f4e5aa5297291e5f22c0e', 'request_id': 'req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.223230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84d367f215f4e5aa5297291e5f22c0e', 'request_id': 'req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.243563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] The token cache is being invalidate because project d84d367f215f4e5aa5297291e5f22c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:11.243563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.244040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.246641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 995/1973] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:11 2022] DELETE /identity/v3/projects/d84d367f215f4e5aa5297291e5f22c0e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:11.250906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:11.265141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35723737-99a6-4092-9d64-ad33a469dd9e service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:11.405862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:11.406923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:11.407504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:11.407828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] PATH_INFO: `/v3/users/1067f05f2e10451c972602d6602f231c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:11.411552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1067f05f2e10451c972602d6602f231c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:11.414120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:11.502928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1067f05f2e10451c972602d6602f231c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.531242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1067f05f2e10451c972602d6602f231c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.533461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:11.557907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1067f05f2e10451c972602d6602f231c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.572135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1067f05f2e10451c972602d6602f231c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.572868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1067f05f2e10451c972602d6602f231c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:11.604858 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 979/1974] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:11 2022] DELETE /identity/v3/users/1067f05f2e10451c972602d6602f231c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:11.833239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:11.835082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:11.859234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69d321-3d07-46c4-aef3-e6e5b35dff4d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:12.001242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:12.002040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.002414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:12.002780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] PATH_INFO: `/v3/users/fa4ab29a210340cc93a39f2e76e9c57b` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:12.004300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4ab29a210340cc93a39f2e76e9c57b)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:12.010466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:12.131708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4ab29a210340cc93a39f2e76e9c57b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.132579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4ab29a210340cc93a39f2e76e9c57b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.145933 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4ab29a210340cc93a39f2e76e9c57b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.146893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4ab29a210340cc93a39f2e76e9c57b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.164397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c99835d4-2754-484f-9b4f-e0984c7f37e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4ab29a210340cc93a39f2e76e9c57b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.195573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:12.197078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 996/1975] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:11 2022] DELETE /identity/v3/users/fa4ab29a210340cc93a39f2e76e9c57b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:12.197238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:12.202037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.202791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:12.202791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:12.226434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2286-f50d-4b27-aea4-7933a9f4343d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:12.241712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:12.243527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:12.344996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:12.413584 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:12.417509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.417509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:12.420204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] PATH_INFO: `/v3/projects/356d5481fb93403bbea5585c08f1800f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:12.423020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356d5481fb93403bbea5585c08f1800f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:12.430229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:12.468032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 997/1976] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:12.479064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:12.483253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:12.529549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356d5481fb93403bbea5585c08f1800f', 'request_id': 'req-fcc738a6-05fa-404b-978d-a2f6ab077ac6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.545520 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356d5481fb93403bbea5585c08f1800f', 'request_id': 'req-fcc738a6-05fa-404b-978d-a2f6ab077ac6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.562238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356d5481fb93403bbea5585c08f1800f', 'request_id': 'req-fcc738a6-05fa-404b-978d-a2f6ab077ac6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.595294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] The token cache is being invalidate because project 356d5481fb93403bbea5585c08f1800f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:12.595294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.600048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-fcc738a6-05fa-404b-978d-a2f6ab077ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:12.601971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 980/1977] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:12 2022] DELETE /identity/v3/projects/356d5481fb93403bbea5585c08f1800f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:12.607367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be93a04-fdaf-4f35-b467-dd9c53bfb723 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.616146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be93a04-fdaf-4f35-b467-dd9c53bfb723 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:12.616530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be93a04-fdaf-4f35-b467-dd9c53bfb723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:12.644425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e35d2-0073-4435-9aec-b5807ebc227b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:12.679213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8be93a04-fdaf-4f35-b467-dd9c53bfb723 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:12.681607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8be93a04-fdaf-4f35-b467-dd9c53bfb723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:12.776199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:12.776856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.777259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:12.777596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:12.779649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:12.802520 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 981/1978] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:12.810902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06254d-2d39-4862-b44b-b40c87ad4ab3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.811193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06254d-2d39-4862-b44b-b40c87ad4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:12.811467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06254d-2d39-4862-b44b-b40c87ad4ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:12.833227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:12.862495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bb06254d-2d39-4862-b44b-b40c87ad4ab3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:12.863602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bb06254d-2d39-4862-b44b-b40c87ad4ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:12.870675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:12.872893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:12.883320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 998/1979] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:12.903940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 982/1980] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:12.905609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:12.920216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29c0b7-5985-4552-99ec-43edb9e96861 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:12.934430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:12.935117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.935384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:12.935690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:12.936360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:12.936691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:12.938457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:12.967073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 999/1981] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:12.971614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06254d-2d39-4862-b44b-b40c87ad4ab3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:12.985411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06254d-2d39-4862-b44b-b40c87ad4ab3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:12.998742 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:12.999468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:12.999796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.000095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.000742 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.006236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.075632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 983/1982] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:12 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:13.079176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.091607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6c6fa-9065-463c-88e4-786b79afc7db admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.143510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:13.188949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.189626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.189908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.190210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.190825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.196283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.243621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1000/1983] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:13 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:13.247805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.267920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2aa51-e0b8-443f-88ff-5e2664ca2c8f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.275187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.275986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.277419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.278536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.279551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.281652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.299346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 984/1984] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:13.303309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.319077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65e721-498e-441a-b189-0213e8a2c190 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.328858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.329843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.330308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.330814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.331727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.334984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.360162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.361428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1001/1985] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:13.376195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cc266-f98a-40e6-9b3a-448c4287e023 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.394905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838aa68-92d2-4fbf-a435-5ffea0eea90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.401937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838aa68-92d2-4fbf-a435-5ffea0eea90f admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.403276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838aa68-92d2-4fbf-a435-5ffea0eea90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.403979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838aa68-92d2-4fbf-a435-5ffea0eea90f admin admin] PATH_INFO: `/v3/projects/b7ab143324e342f586c9fd82a2a677a6/users/9182e123ff9f44779d707e66b8fab149/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.431794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.437605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:13.443074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838aa68-92d2-4fbf-a435-5ffea0eea90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ab143324e342f586c9fd82a2a677a6, user_id=9182e123ff9f44779d707e66b8fab149, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.446244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838aa68-92d2-4fbf-a435-5ffea0eea90f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.467033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42b662-eef6-4681-ad34-cc81188d1bbf admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.493658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 985/1986] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:13 2022] PUT /identity/v3/projects/b7ab143324e342f586c9fd82a2a677a6/users/9182e123ff9f44779d707e66b8fab149/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:13.506503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324387e-be3f-4be7-ad64-a1eb2fa3e18e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.506786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324387e-be3f-4be7-ad64-a1eb2fa3e18e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.507061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324387e-be3f-4be7-ad64-a1eb2fa3e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.557270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e324387e-be3f-4be7-ad64-a1eb2fa3e18e None None] MFA Rules not processed for user `9182e123ff9f44779d707e66b8fab149`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:13.558726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e324387e-be3f-4be7-ad64-a1eb2fa3e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:13.584905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.585571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.585849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.586312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] PATH_INFO: `/v3/projects/9248b46d285e4499aae73438b5442db0` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.587616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9248b46d285e4499aae73438b5442db0)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.590462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.653128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9248b46d285e4499aae73438b5442db0', 'request_id': 'req-331cff5c-104b-4d25-8389-d2610f29b39e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:13.655834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 986/1987] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:13.658915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324387e-be3f-4be7-ad64-a1eb2fa3e18e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.662037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9248b46d285e4499aae73438b5442db0', 'request_id': 'req-331cff5c-104b-4d25-8389-d2610f29b39e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:13.669545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9248b46d285e4499aae73438b5442db0', 'request_id': 'req-331cff5c-104b-4d25-8389-d2610f29b39e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:13.671075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324387e-be3f-4be7-ad64-a1eb2fa3e18e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.687037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] The token cache is being invalidate because project 9248b46d285e4499aae73438b5442db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:13.687346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:13.687992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:13.689520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1002/1988] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:13 2022] DELETE /identity/v3/projects/9248b46d285e4499aae73438b5442db0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:13.693606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.695205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:13.736056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.736685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.736955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.737227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.737861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.739818 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.749888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:13.779572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 987/1989] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:13 2022] POST /identity/v3/projects => generated 397 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:13.784260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.787067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:13.800057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cff5c-104b-4d25-8389-d2610f29b39e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.811782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:13.887983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafaed-c312-4ffc-8068-5e2d70c6cf94 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.892781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.893426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.893949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.894220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] PATH_INFO: `/v3/users/5bdc485902684410bda3ad5ac1638530` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.895448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.896102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdc485902684410bda3ad5ac1638530)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.896549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.897003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.897447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.898252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:13.899047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.901181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:13.961856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 988/1990] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:13 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:13.965805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:13.983332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a141a-5f19-438f-b4f6-a882fe82f960 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:13.990180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:13.991059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:13.998305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:13.998699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:13.999902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:14.001792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:14.020621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 989/1991] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:14.024539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:14.042383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e0ace-aa08-4057-b4aa-e969d5212caf admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:14.048674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:14.049447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:14.049729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:14.050004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] PATH_INFO: `/v3/projects/71c746acd82e420c919ff322ab9175b4/users/7d9bddc501d2449f988064d236fc60a4/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:14.054308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdc485902684410bda3ad5ac1638530'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.055488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdc485902684410bda3ad5ac1638530'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.069540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c746acd82e420c919ff322ab9175b4, user_id=7d9bddc501d2449f988064d236fc60a4, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:14.072178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdc485902684410bda3ad5ac1638530'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.072953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdc485902684410bda3ad5ac1638530'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.073064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:14.096374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdc485902684410bda3ad5ac1638530'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.107603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 990/1992] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:14 2022] PUT /identity/v3/projects/71c746acd82e420c919ff322ab9175b4/users/7d9bddc501d2449f988064d236fc60a4/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:14.108227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:14.110099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:14.122754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1003/1993] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:13 2022] DELETE /identity/v3/users/5bdc485902684410bda3ad5ac1638530 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:14.194269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1c5da-095f-425e-97fd-31a5a84e9ee4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:14.352053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26294a7-5361-4de4-bc96-a29727f95bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:14.366278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26294a7-5361-4de4-bc96-a29727f95bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:14.366278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26294a7-5361-4de4-bc96-a29727f95bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:14.366278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26294a7-5361-4de4-bc96-a29727f95bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:14.366278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26294a7-5361-4de4-bc96-a29727f95bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:14.370569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26294a7-5361-4de4-bc96-a29727f95bb0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:14.413240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 991/1994] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:14.414372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:14.433221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57fd228-fef0-4cdb-ac41-c7a279461f9a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:14.445781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:14.447032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:14.447481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:14.447941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] PATH_INFO: `/v3/projects/71c746acd82e420c919ff322ab9175b4/users/7d9bddc501d2449f988064d236fc60a4/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:14.454703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c746acd82e420c919ff322ab9175b4, user_id=7d9bddc501d2449f988064d236fc60a4, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:14.458696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:14.496897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1004/1995] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:14 2022] PUT /identity/v3/projects/71c746acd82e420c919ff322ab9175b4/users/7d9bddc501d2449f988064d236fc60a4/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:14.507329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:14.507883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:14.507883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:14.557751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:14.565476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] MFA Rules not processed for user `7d9bddc501d2449f988064d236fc60a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:14.566913 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:14.642776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:14.645880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:14.749257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 992/1996] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:14 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:14.750366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:14.752044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:14.780261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:14.800820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babf48-2d41-49ec-9828-481cd2699cc5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:14.808708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:14.809686 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:14.810066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:14.810426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] PATH_INFO: `/v3/users/45f20bdd108046dc830c7bdbea4b3b80` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:14.812411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f20bdd108046dc830c7bdbea4b3b80)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:14.817240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:14.885821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f20bdd108046dc830c7bdbea4b3b80'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.886510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f20bdd108046dc830c7bdbea4b3b80'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.888660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6749ac-bc10-4f85-9d3f-665882adffd8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:14.894603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f20bdd108046dc830c7bdbea4b3b80'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.895270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f20bdd108046dc830c7bdbea4b3b80'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.895671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:14.896656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:14.897263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:14.897693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] PATH_INFO: `/v3/projects/6e5ec14979ed476cb6fe325d0cf141b5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:14.900126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5ec14979ed476cb6fe325d0cf141b5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:14.903248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:14.904856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f20bdd108046dc830c7bdbea4b3b80'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:14.926534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1005/1997] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:14 2022] DELETE /identity/v3/users/45f20bdd108046dc830c7bdbea4b3b80 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:14.927401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:14.928751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:14.995449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5ec14979ed476cb6fe325d0cf141b5', 'request_id': 'req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.010282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5ec14979ed476cb6fe325d0cf141b5', 'request_id': 'req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.021196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5ec14979ed476cb6fe325d0cf141b5', 'request_id': 'req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.032850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5fb7-ca92-40c0-8981-fc91383533e0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:15.036001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] The token cache is being invalidate because project 6e5ec14979ed476cb6fe325d0cf141b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:15.036509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.037624 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bc67e42e-a6e2-4ec0-bcce-bdc9c0f55271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.040457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 993/1998] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:14 2022] DELETE /identity/v3/projects/6e5ec14979ed476cb6fe325d0cf141b5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:15.042878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:15.043659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:15.044119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:15.072506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:15.074746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:15.101397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:15.102029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:15.102310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:15.102580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:15.104848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:15.112716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:15.162047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:15.189779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 994/1999] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:15.191056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:15.192415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:15.215677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf1b72-7c5f-4cd0-8186-43b6c0de845f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:15.221542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:15.221779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:15.222396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:15.222840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:15.223225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] PATH_INFO: `/v3/users/846f574486304516841c813fc68830ec` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:15.225782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846f574486304516841c813fc68830ec)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:15.227382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:15.228180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:15.244878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1006/2000] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:14 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:15.245814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:15.248239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:15.346578 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846f574486304516841c813fc68830ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.357130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846f574486304516841c813fc68830ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.375261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846f574486304516841c813fc68830ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.381497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe16cf9-360b-43b2-992a-d1e2fb3bd8b6 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:15.386999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:15.387728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:15.388059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:15.388272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:15.389943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846f574486304516841c813fc68830ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.391542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846f574486304516841c813fc68830ec'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:15.400526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:15.407324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:15.407502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 995/2001] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:15 2022] DELETE /identity/v3/users/846f574486304516841c813fc68830ec => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:15.417476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1007/2002] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:15.455256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:15.457124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:15.592347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dec5c5-c175-4bd1-ba08-c62e2a9bc0b7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:15.598208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:15.599298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:15.600155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:15.600717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:15.603633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:15.677594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:15.680533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:15.682138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:15.703643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 996/2003] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:15 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:16.052684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.095484 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f73a9-58a0-4965-95fe-bdf95858ae75 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.160780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.162302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.209707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.210459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.210828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.211193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] PATH_INFO: `/v3/projects/36bb29b5bf6f43599c546468b5a88edd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.214720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bb29b5bf6f43599c546468b5a88edd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.217414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.293967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631048-1c2a-4433-8a3f-b76d125adaf7 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.296787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bb29b5bf6f43599c546468b5a88edd', 'request_id': 'req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.304202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bb29b5bf6f43599c546468b5a88edd', 'request_id': 'req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.312380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bb29b5bf6f43599c546468b5a88edd', 'request_id': 'req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.334243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] The token cache is being invalidate because project 36bb29b5bf6f43599c546468b5a88edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:16.334606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.335280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b2f4c2c2-549a-4940-9cf5-94c5e5925a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.340493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1008/2004] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:16 2022] DELETE /identity/v3/projects/36bb29b5bf6f43599c546468b5a88edd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:16.354318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde0d9-644a-452b-bc64-a5b7ea10b535 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.359158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde0d9-644a-452b-bc64-a5b7ea10b535 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.359488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde0d9-644a-452b-bc64-a5b7ea10b535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.393878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:16.405399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7fcde0d9-644a-452b-bc64-a5b7ea10b535 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:16.407411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7fcde0d9-644a-452b-bc64-a5b7ea10b535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.472974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.473863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.476431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.476638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] PATH_INFO: `/v3/projects/7388c390ea3a4b25ae6d1d2f94695d51` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.478188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7388c390ea3a4b25ae6d1d2f94695d51)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.481535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.527679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1009/2005] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:16.537330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c442-7400-4eb6-9340-ac3cc6fd7ac5 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.537768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c442-7400-4eb6-9340-ac3cc6fd7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.538177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58c442-7400-4eb6-9340-ac3cc6fd7ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.561805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0e58c442-7400-4eb6-9340-ac3cc6fd7ac5 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:16.563341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0e58c442-7400-4eb6-9340-ac3cc6fd7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.580632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7388c390ea3a4b25ae6d1d2f94695d51', 'request_id': 'req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.595709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7388c390ea3a4b25ae6d1d2f94695d51', 'request_id': 'req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.604241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7388c390ea3a4b25ae6d1d2f94695d51', 'request_id': 'req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.616420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] The token cache is being invalidate because project 7388c390ea3a4b25ae6d1d2f94695d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:16.616901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.617679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.619323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 997/2006] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:16 2022] DELETE /identity/v3/projects/7388c390ea3a4b25ae6d1d2f94695d51 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:16.620129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.621612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.649383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1010/2007] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:16.650438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ec70-3451-443b-a0fb-d7363ce23f61 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.650720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ec70-3451-443b-a0fb-d7363ce23f61 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.650992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ec70-3451-443b-a0fb-d7363ce23f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.662181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:16.673452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f5b7ec70-3451-443b-a0fb-d7363ce23f61 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:16.674839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f5b7ec70-3451-443b-a0fb-d7363ce23f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.684026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1011/2008] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:16.684875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ec70-3451-443b-a0fb-d7363ce23f61 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.696433 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ec70-3451-443b-a0fb-d7363ce23f61 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.703309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5d76f-33b5-467c-9ed4-ba88fbf09855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.703959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5d76f-33b5-467c-9ed4-ba88fbf09855 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.704237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5d76f-33b5-467c-9ed4-ba88fbf09855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.704506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5d76f-33b5-467c-9ed4-ba88fbf09855 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.705160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5d76f-33b5-467c-9ed4-ba88fbf09855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:16.705462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5d76f-33b5-467c-9ed4-ba88fbf09855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.706096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc20df9-1e87-4ccb-a17b-dab690a3eadf admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.707058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5d76f-33b5-467c-9ed4-ba88fbf09855 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.711884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.712910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.713236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.713457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] PATH_INFO: `/v3/users/02b7d1b52c024cadaa402dbd09123184` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.715217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b7d1b52c024cadaa402dbd09123184)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.717322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.727093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1012/2009] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:16.729245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5ac58-0e02-40f6-bbdd-e0f86fc69ba4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.729748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5ac58-0e02-40f6-bbdd-e0f86fc69ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.730250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5ac58-0e02-40f6-bbdd-e0f86fc69ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.750829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-83e5ac58-0e02-40f6-bbdd-e0f86fc69ba4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:16.752122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-83e5ac58-0e02-40f6-bbdd-e0f86fc69ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.761076 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1013/2010] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:16.761975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5ac58-0e02-40f6-bbdd-e0f86fc69ba4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.772781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5ac58-0e02-40f6-bbdd-e0f86fc69ba4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.774583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b7d1b52c024cadaa402dbd09123184'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.777436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.778035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.778318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.778590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.779211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.781153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.782451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b7d1b52c024cadaa402dbd09123184'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.795292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b7d1b52c024cadaa402dbd09123184'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.804135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b7d1b52c024cadaa402dbd09123184'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.804764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b7d1b52c024cadaa402dbd09123184'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:16.809745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1014/2011] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:16.810398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.811994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.814860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 998/2012] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:16 2022] DELETE /identity/v3/users/02b7d1b52c024cadaa402dbd09123184 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:16.815043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.816774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.881857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fa3f6-4535-4033-8a9c-13b73427e67b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.883995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851105-625b-4818-ae47-a7b3da5508f5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.887164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8ea28-3253-4298-871d-a69cbf410517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.887885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8ea28-3253-4298-871d-a69cbf410517 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.888167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8ea28-3253-4298-871d-a69cbf410517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.888601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8ea28-3253-4298-871d-a69cbf410517 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.890529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8ea28-3253-4298-871d-a69cbf410517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:16.890840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.891160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8ea28-3253-4298-871d-a69cbf410517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.892240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.892897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.893418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.894711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.895191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8ea28-3253-4298-871d-a69cbf410517 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.898629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:16.899500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.920198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1015/2013] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:16.925386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3ffd-5b84-4431-8c24-162dbf469d31 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.925687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3ffd-5b84-4431-8c24-162dbf469d31 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.925959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3ffd-5b84-4431-8c24-162dbf469d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.934304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 999/2014] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:16.935146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.947480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7fc91-73c8-45a5-9aea-22493b219c01 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.949457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-872b3ffd-5b84-4431-8c24-162dbf469d31 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:16.950674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-872b3ffd-5b84-4431-8c24-162dbf469d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.953667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.954291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.954573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.954849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.955607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.957638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.959667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1016/2015] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:16.960455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b3ffd-5b84-4431-8c24-162dbf469d31 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.971307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b3ffd-5b84-4431-8c24-162dbf469d31 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:16.977447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:16.978250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:16.978648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:16.979021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:16.979760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:16.981428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:16.989633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1000/2016] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:16.990650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:16.995435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1017/2017] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:16.995569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:16.997297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.007612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b5270-32fd-45cf-a579-b46e18c91ff6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.019186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:17.057901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a321-9603-4d08-b474-2f7b8d231f54 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.061897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.062506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.062787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.063059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.068153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.068742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.069021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.069289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.069900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.071869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.095199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1018/2018] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:16 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:17.096114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.106263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a54bba-fce5-4917-8d75-8096bfd99b5c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.111706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.112276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.112556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.112828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.113552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.115284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.128241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1019/2019] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:17.129178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.138667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.140396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.140831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e210b-07d4-4aa7-8798-c9048f1edd2b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.147262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.147904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.148184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.148452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.149090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.151314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.153762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1001/2020] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:17.155045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.168030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ead5c-55be-4a1c-870b-a2b2675a4449 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.173884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1020/2021] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:17.177165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.178679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.180319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.180593 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.180865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] PATH_INFO: `/v3/projects/b82cd582e25f45e9b3bb4105185beaa5/users/5034cbba9e14456886042f03a7e56adb/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.193461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12152bbf-4c04-4c9d-8bc6-d8fff3e94a76 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.203977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82cd582e25f45e9b3bb4105185beaa5, user_id=5034cbba9e14456886042f03a7e56adb, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.206958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.215475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff1a10-eb8d-4370-be6e-f41a0819ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.216305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1a10-eb8d-4370-be6e-f41a0819ded3 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.216652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1a10-eb8d-4370-be6e-f41a0819ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.216992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff1a10-eb8d-4370-be6e-f41a0819ded3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.217709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff1a10-eb8d-4370-be6e-f41a0819ded3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.219540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff1a10-eb8d-4370-be6e-f41a0819ded3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.232125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1002/2022] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:17 2022] PUT /identity/v3/projects/b82cd582e25f45e9b3bb4105185beaa5/users/5034cbba9e14456886042f03a7e56adb/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:17.234078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1021/2023] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:17.238335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.243043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e0d8-1a53-4cd1-ab12-3a9b4304bda8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.243467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e0d8-1a53-4cd1-ab12-3a9b4304bda8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.243955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e0d8-1a53-4cd1-ab12-3a9b4304bda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.276899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4691e0d8-1a53-4cd1-ab12-3a9b4304bda8 None None] MFA Rules not processed for user `5034cbba9e14456886042f03a7e56adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:17.278359 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4691e0d8-1a53-4cd1-ab12-3a9b4304bda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:17.337088 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d87ac1-22b0-4fa3-b3e0-4f2c4e6d85e2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.343445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.344340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.344689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.345031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] PATH_INFO: `/v3/projects/054898f767e84f61863327626ac62f47/users/3504f4bd593c4fb38dc5e18b69b5f9f0/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.363779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054898f767e84f61863327626ac62f47, user_id=3504f4bd593c4fb38dc5e18b69b5f9f0, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.367412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.390372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1003/2024] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:17 2022] PUT /identity/v3/projects/054898f767e84f61863327626ac62f47/users/3504f4bd593c4fb38dc5e18b69b5f9f0/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:17.392853 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.394241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1022/2025] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:17.395090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:17.406608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691e0d8-1a53-4cd1-ab12-3a9b4304bda8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.424760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691e0d8-1a53-4cd1-ab12-3a9b4304bda8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.439538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:17.455654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:17.503805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892d425-4885-47b7-8aa7-6661c4106f37 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.509382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.510037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.510372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.510748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] PATH_INFO: `/v3/users/42b6f4e9cab64ea4857f058a94fa323d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.512196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b6f4e9cab64ea4857f058a94fa323d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.514973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.518812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72604131-63ef-4961-917b-abf444642e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.519515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604131-63ef-4961-917b-abf444642e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.519902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604131-63ef-4961-917b-abf444642e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.520285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72604131-63ef-4961-917b-abf444642e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.520952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604131-63ef-4961-917b-abf444642e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.522939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72604131-63ef-4961-917b-abf444642e1e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.569986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1023/2026] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:17 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:17.572356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.572356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.572356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.589236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b6f4e9cab64ea4857f058a94fa323d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.600353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b6f4e9cab64ea4857f058a94fa323d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.606231 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] MFA Rules not processed for user `3504f4bd593c4fb38dc5e18b69b5f9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:17.607748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:17.623248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b6f4e9cab64ea4857f058a94fa323d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.633986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b6f4e9cab64ea4857f058a94fa323d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.634721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b6f4e9cab64ea4857f058a94fa323d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.643285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1004/2027] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:17 2022] DELETE /identity/v3/users/42b6f4e9cab64ea4857f058a94fa323d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:17.644421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.645969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:17.705950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1024/2028] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:17.707075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.708947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:17.731401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fc584-53d9-43d0-ae91-d40c2ff13847 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.739090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.739860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.740142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.740414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] PATH_INFO: `/v3/projects/6660b857356d4682b05473d7ff2091a3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.751099 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6660b857356d4682b05473d7ff2091a3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.753150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.826024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6660b857356d4682b05473d7ff2091a3', 'request_id': 'req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.828160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:17.830923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd961e12-a9fd-4a31-88e0-0d213f962f0e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.841115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6660b857356d4682b05473d7ff2091a3', 'request_id': 'req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.849982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6660b857356d4682b05473d7ff2091a3', 'request_id': 'req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.867726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] The token cache is being invalidate because project 6660b857356d4682b05473d7ff2091a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:17.868162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.869638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ea9779c9-ca66-4f53-b45d-9d3135ee4c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:17.875380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1005/2029] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:17 2022] DELETE /identity/v3/projects/6660b857356d4682b05473d7ff2091a3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:17.875380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.875380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.875380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.886519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:17.899718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:17.901640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:17.918319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.919109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.919485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.920047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.920860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.923004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.951467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1025/2030] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:17 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:17.951467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:17.953240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:17.977093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484323c-6073-4b7e-be0c-e524a0fa8d3d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:17.983629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:17.984662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:17.985244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:17.985806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:17.987009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:17.990681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:17.992993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1006/2031] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:17.995603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.006023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.037009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1026/2032] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:17 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:18.038938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.041676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.046289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96556f1-9a93-48f2-9509-adede6be3716 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.110741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.111383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.111894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.112009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] PATH_INFO: `/v3/users/cf6d5e0f19804b978f2eff09e77334c2` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.113146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6d5e0f19804b978f2eff09e77334c2)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.115157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.116461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a2e9-5f0b-42d7-9efc-c44d45efb66c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.122547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.123475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.123805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.124140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.124976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.126673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.137257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1027/2033] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:18.137257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.142685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.170040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6d5e0f19804b978f2eff09e77334c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.176969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6d5e0f19804b978f2eff09e77334c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.189416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6d5e0f19804b978f2eff09e77334c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.199919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6d5e0f19804b978f2eff09e77334c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.200597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6d5e0f19804b978f2eff09e77334c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.202210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:18.214117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753da087-7369-4f52-a4ae-5c42df22ae68 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.219236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1007/2034] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:17 2022] DELETE /identity/v3/users/cf6d5e0f19804b978f2eff09e77334c2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:18.220423 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.222844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.292087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.292739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.293277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.293600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.296562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.319291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:18.322017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3194950-c908-4631-9094-e4a69de925d3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.327632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.328382 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.329057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.329057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.329866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.332001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.356199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1008/2035] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:18 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:18.360441 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.362726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.376132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013fd45-595b-42ed-9aa9-9645e334a3b9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.379050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.380757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.380866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.381543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.381843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.382085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] PATH_INFO: `/v3/projects/55d8892e763f42da8c554f28b9cf6a71/users/11fcb9f265674b6fb117b6d675bb8b52/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.400241 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d8892e763f42da8c554f28b9cf6a71, user_id=11fcb9f265674b6fb117b6d675bb8b52, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.401404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1028/2036] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:18.403744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.411648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.424791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1ebd-6193-4826-b565-17e2f93736f3 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.426692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1009/2037] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:18 2022] PUT /identity/v3/projects/55d8892e763f42da8c554f28b9cf6a71/users/11fcb9f265674b6fb117b6d675bb8b52/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:18.428521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.493890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.494588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.495038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.495291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.496153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.498925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.501498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c4732-f0a4-47fe-a0b8-cbb52b9ea495 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.507048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.508021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.508341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.508619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.509315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.511109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.512277 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1029/2038] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:18.517071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.526986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1010/2039] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:18.530577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c04a2-82b9-44d9-881b-d05c579fd31a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.531265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.538118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.538467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.539103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.539473 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] PATH_INFO: `/v3/projects/176b8372698d45e2b867ea23b67b90cd/users/d8c00927441e47e396ee952361b3a291/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.542446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a23f-6088-4385-9d06-b6e6a72bc7bf admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.548609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969e4f5-8684-4234-a816-ce78568c5ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.549516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969e4f5-8684-4234-a816-ce78568c5ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.549866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969e4f5-8684-4234-a816-ce78568c5ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.550233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969e4f5-8684-4234-a816-ce78568c5ba0 admin admin] PATH_INFO: `/v3/projects/55d8892e763f42da8c554f28b9cf6a71/users/11fcb9f265674b6fb117b6d675bb8b52/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.553073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969e4f5-8684-4234-a816-ce78568c5ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d8892e763f42da8c554f28b9cf6a71, user_id=11fcb9f265674b6fb117b6d675bb8b52, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.555847 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969e4f5-8684-4234-a816-ce78568c5ba0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.560349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=176b8372698d45e2b867ea23b67b90cd, user_id=d8c00927441e47e396ee952361b3a291, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.563345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.570120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1011/2040] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:18 2022] PUT /identity/v3/projects/55d8892e763f42da8c554f28b9cf6a71/users/11fcb9f265674b6fb117b6d675bb8b52/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:18.581330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266ce28-cb6c-4c63-aed0-17fd4cf2e534 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.583917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266ce28-cb6c-4c63-aed0-17fd4cf2e534 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.583917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266ce28-cb6c-4c63-aed0-17fd4cf2e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.584136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1030/2041] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:18 2022] PUT /identity/v3/projects/176b8372698d45e2b867ea23b67b90cd/users/d8c00927441e47e396ee952361b3a291/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:18.587704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.636827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3266ce28-cb6c-4c63-aed0-17fd4cf2e534 None None] MFA Rules not processed for user `11fcb9f265674b6fb117b6d675bb8b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:18.638083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3266ce28-cb6c-4c63-aed0-17fd4cf2e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.685171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:18.688757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ded5f-8a02-4a60-b177-22e16d894c9f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.695152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.695152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.695517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.695959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.696595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.698299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.712397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1031/2042] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:18.717193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.719938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.733166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1012/2043] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:18.734104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266ce28-cb6c-4c63-aed0-17fd4cf2e534 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.740767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad15e9-4b90-4814-afca-7e42dc6cad41 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.746833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.747648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.747936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.748256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] PATH_INFO: `/v3/projects/b7e139a202be43508c63546b88dfc9fc` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.749538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e139a202be43508c63546b88dfc9fc)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.751758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.758909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266ce28-cb6c-4c63-aed0-17fd4cf2e534 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.768622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.769495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.769836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.770486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] PATH_INFO: `/v3/projects/176b8372698d45e2b867ea23b67b90cd/users/d8c00927441e47e396ee952361b3a291/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.772573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=176b8372698d45e2b867ea23b67b90cd, user_id=d8c00927441e47e396ee952361b3a291, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:18.773664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:18.775572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:18.787795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1013/2044] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:18 2022] PUT /identity/v3/projects/176b8372698d45e2b867ea23b67b90cd/users/d8c00927441e47e396ee952361b3a291/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:18.796721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.798952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.821743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e139a202be43508c63546b88dfc9fc', 'request_id': 'req-3ba09303-09cd-4f30-9aba-d245e48013ee'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.828922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e139a202be43508c63546b88dfc9fc', 'request_id': 'req-3ba09303-09cd-4f30-9aba-d245e48013ee'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.838017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e139a202be43508c63546b88dfc9fc', 'request_id': 'req-3ba09303-09cd-4f30-9aba-d245e48013ee'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.858217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] The token cache is being invalidate because project b7e139a202be43508c63546b88dfc9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:18.858541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.859210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-3ba09303-09cd-4f30-9aba-d245e48013ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:18.860818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1032/2045] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:18 2022] DELETE /identity/v3/projects/b7e139a202be43508c63546b88dfc9fc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:18.861920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.862200 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.862471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.867462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b7556-b235-4462-8e54-5a8c9f2de18a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:18.893771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] MFA Rules not processed for user `d8c00927441e47e396ee952361b3a291`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:18.895403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.923817 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7622a-3f4f-4ed8-9496-0146e0b19362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:18.923817 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7622a-3f4f-4ed8-9496-0146e0b19362 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:18.924183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7622a-3f4f-4ed8-9496-0146e0b19362 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:18.924975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7622a-3f4f-4ed8-9496-0146e0b19362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:18.927142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dae7622a-3f4f-4ed8-9496-0146e0b19362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:18.983569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1033/2046] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:18.984439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:18.985856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:19.011396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7622a-3f4f-4ed8-9496-0146e0b19362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.016443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7622a-3f4f-4ed8-9496-0146e0b19362 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.028626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1014/2047] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:19.030042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.030334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.030603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.052450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:19.053663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:19.060653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13392d3-2b4a-4184-87b2-6b692774d608 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.062714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1015/2048] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:19.064597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.065761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.066361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.066642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.066911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] PATH_INFO: `/v3/projects/5f77c2640fa34a3ca373385645a25828` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.068150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f77c2640fa34a3ca373385645a25828)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.070113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.072060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:19.094885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e69214-cfaa-4398-b30f-8dd4b5a87c53 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.099029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.099732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.100012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.100277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.102850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:19.118084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:19.122841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:19.141125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f77c2640fa34a3ca373385645a25828', 'request_id': 'req-f470f5cc-3ae9-43ee-9414-dff54486ed12'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.147972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f77c2640fa34a3ca373385645a25828', 'request_id': 'req-f470f5cc-3ae9-43ee-9414-dff54486ed12'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.156081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f77c2640fa34a3ca373385645a25828', 'request_id': 'req-f470f5cc-3ae9-43ee-9414-dff54486ed12'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.172991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] The token cache is being invalidate because project 5f77c2640fa34a3ca373385645a25828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:19.173419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.174651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f470f5cc-3ae9-43ee-9414-dff54486ed12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.176827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1034/2049] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:18 2022] DELETE /identity/v3/projects/5f77c2640fa34a3ca373385645a25828 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:19.178055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d3e28-900e-481e-942b-63660d57ccdf None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.178363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d3e28-900e-481e-942b-63660d57ccdf None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.178593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d3e28-900e-481e-942b-63660d57ccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.217588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.217588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.220293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-489d3e28-900e-481e-942b-63660d57ccdf None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:19.220293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-489d3e28-900e-481e-942b-63660d57ccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:19.228283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1016/2050] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:19.229326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.241643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288314d8-5608-48d0-8688-327c8af5be99 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.334476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1035/2051] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:19.338864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d3e28-900e-481e-942b-63660d57ccdf None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.350245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d3e28-900e-481e-942b-63660d57ccdf None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.356733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.357647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.358001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.358521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] PATH_INFO: `/v3/users/1ad68a31408c4e48b8655e5938f92111` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.359771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad68a31408c4e48b8655e5938f92111)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.363088 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.363967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.365799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.367770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.368126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.369096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:19.370435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.373137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.411218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1036/2052] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:19.416314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.433014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7c097-6950-49fe-8374-86b1848bbc82 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.441813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.442481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.442779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.443465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.444181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.446374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.476203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad68a31408c4e48b8655e5938f92111'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.486867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad68a31408c4e48b8655e5938f92111'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.504675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad68a31408c4e48b8655e5938f92111'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.505274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1037/2053] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:19 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:19.506202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.517544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad68a31408c4e48b8655e5938f92111'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.518491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad68a31408c4e48b8655e5938f92111'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.530702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1017/2054] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:19 2022] DELETE /identity/v3/users/1ad68a31408c4e48b8655e5938f92111 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:19.612024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbfea-2690-4f38-a1a9-67946c94dd1b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.691498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:19.755320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.755995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.756305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.756538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.757173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.765175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.820048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1038/2055] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:19 2022] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:19.824082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.827954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:19.836472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.838189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:19.851242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53cc62-8637-42b2-8f67-db29baa2ca7b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.852311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452df00-3c0c-484c-8b27-4769e18e8f20 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.856415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.857062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.857341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.857616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] PATH_INFO: `/v3/users/5034cbba9e14456886042f03a7e56adb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.858659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.858866 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5034cbba9e14456886042f03a7e56adb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.859281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.859564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.859870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.860522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.860867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.862230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.879692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1018/2056] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:19.882703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.899066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e2389-f371-475e-b060-9deb9d65f714 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.907096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.908010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.908302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.908580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.909379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.911057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.925592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1019/2057] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:19.927097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:19.943149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5034cbba9e14456886042f03a7e56adb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.943277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8d3c0-b0ac-4796-b2a9-f76df73cd1de admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:19.943617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5034cbba9e14456886042f03a7e56adb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.948331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:19.948835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:19.949134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:19.949842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] PATH_INFO: `/v3/projects/55d34ce96e6c4960970ce22d59d4b0e7/users/a902177cf8254c3fa89e740e63ebe463/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:19.958868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5034cbba9e14456886042f03a7e56adb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.960755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5034cbba9e14456886042f03a7e56adb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.963335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:19.968673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d34ce96e6c4960970ce22d59d4b0e7, user_id=a902177cf8254c3fa89e740e63ebe463, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:19.972028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-708ddb0e-0fe5-4cb1-bbe9-f2ee34176cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5034cbba9e14456886042f03a7e56adb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:19.972188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:19.989244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1020/2058] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:19 2022] PUT /identity/v3/projects/55d34ce96e6c4960970ce22d59d4b0e7/users/a902177cf8254c3fa89e740e63ebe463/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:19.990218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.001108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.005042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1039/2059] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:19 2022] DELETE /identity/v3/users/5034cbba9e14456886042f03a7e56adb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:20.006328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aff18d-da05-44e4-bc40-44b47b8e7a8f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.006612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aff18d-da05-44e4-bc40-44b47b8e7a8f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.006906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aff18d-da05-44e4-bc40-44b47b8e7a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.040223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-79aff18d-da05-44e4-bc40-44b47b8e7a8f None None] MFA Rules not processed for user `a902177cf8254c3fa89e740e63ebe463`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:20.041735 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-79aff18d-da05-44e4-bc40-44b47b8e7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.096300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de752ba1-84ef-49c4-b2af-e39470a50b01 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.115392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1040/2060] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:20.116795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.117173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.117542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.138133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:20.139555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.160921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:20.166748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.167402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.167714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.168110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] PATH_INFO: `/v3/projects/13d81db9fcbb416cb87f3ed0a9a0e546` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.170059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d81db9fcbb416cb87f3ed0a9a0e546)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.172046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.212400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1041/2061] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:20.213196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.217455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.225992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d81db9fcbb416cb87f3ed0a9a0e546', 'request_id': 'req-655cd926-e35a-4b4d-9a02-44f88799ab6d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.230053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdab9cd-edeb-463e-8da3-c438ab419992 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.236854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d81db9fcbb416cb87f3ed0a9a0e546', 'request_id': 'req-655cd926-e35a-4b4d-9a02-44f88799ab6d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.247157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d81db9fcbb416cb87f3ed0a9a0e546', 'request_id': 'req-655cd926-e35a-4b4d-9a02-44f88799ab6d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.260366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] The token cache is being invalidate because project 13d81db9fcbb416cb87f3ed0a9a0e546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:20.260763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.261635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.267761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1021/2062] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:19 2022] DELETE /identity/v3/projects/13d81db9fcbb416cb87f3ed0a9a0e546 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:20.267761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.267761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.312785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:20.331455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60212a2-503d-4ed1-a813-248a99a275eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.332290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60212a2-503d-4ed1-a813-248a99a275eb admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.332518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60212a2-503d-4ed1-a813-248a99a275eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.332823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60212a2-503d-4ed1-a813-248a99a275eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.333457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60212a2-503d-4ed1-a813-248a99a275eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.335455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60212a2-503d-4ed1-a813-248a99a275eb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.365135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd926-e35a-4b4d-9a02-44f88799ab6d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.373102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1042/2063] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:20.373102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.373102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.373577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.398494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:20.399554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.425514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c38d5-ac5c-423a-8f5b-84172b4493af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.427077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c38d5-ac5c-423a-8f5b-84172b4493af service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.427369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c38d5-ac5c-423a-8f5b-84172b4493af service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.427679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c38d5-ac5c-423a-8f5b-84172b4493af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.430314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-003c38d5-ac5c-423a-8f5b-84172b4493af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.504982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1043/2064] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:20.504982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.504982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.517149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2b7c-ea07-4283-8d5c-ba31cd6fcec7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.523985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.524606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.524885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.525155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.525787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.526188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c38d5-ac5c-423a-8f5b-84172b4493af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.528173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.528548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c38d5-ac5c-423a-8f5b-84172b4493af service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.542021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1022/2065] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:20.543607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9da1-95fb-465c-9051-b73a5ee7845f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.544332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9da1-95fb-465c-9051-b73a5ee7845f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.544705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9da1-95fb-465c-9051-b73a5ee7845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.551770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1044/2066] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:20.555443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.557205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.570348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0a4f9da1-95fb-465c-9051-b73a5ee7845f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:20.570769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f781-59c9-4e04-9d5a-50d5c145dac5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.571823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0a4f9da1-95fb-465c-9051-b73a5ee7845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.576827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.577823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.578164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.578695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] PATH_INFO: `/v3/users/9182e123ff9f44779d707e66b8fab149` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.580356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9182e123ff9f44779d707e66b8fab149)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.582961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.583965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1023/2067] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:20.585095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9da1-95fb-465c-9051-b73a5ee7845f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.605294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9da1-95fb-465c-9051-b73a5ee7845f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.611476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.612276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.612632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.612960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.613671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.615642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.627246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:20.630456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1024/2068] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:20.632824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.649266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21961d-f487-4236-a7bb-9cd0a19dd474 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.654081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9182e123ff9f44779d707e66b8fab149'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.654772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9182e123ff9f44779d707e66b8fab149'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.658942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.659667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.659990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.660306 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.660990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:20.661338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.663604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.666011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9182e123ff9f44779d707e66b8fab149'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.667983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9182e123ff9f44779d707e66b8fab149'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.679192 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9182e123ff9f44779d707e66b8fab149'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:20.682740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1025/2069] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:20.683464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.686656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.704756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1045/2070] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:20 2022] DELETE /identity/v3/users/9182e123ff9f44779d707e66b8fab149 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:20.707464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.709477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:20.712598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be162a-8c25-4b6f-ba3e-9af9a71b77ea admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.862045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64d881-baac-4932-9ac5-98f5ad3dee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.862708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64d881-baac-4932-9ac5-98f5ad3dee20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.862988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64d881-baac-4932-9ac5-98f5ad3dee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.863626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64d881-baac-4932-9ac5-98f5ad3dee20 admin admin] PATH_INFO: `/v3/projects/87ad74fef80d4cf68277362e4341a326/users/6adb559049184ba293ef4b5de477e277/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.870660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:20.876723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f08fb-b1d0-41ff-b301-30145259d76e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:20.888401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:20.889977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.890914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64d881-baac-4932-9ac5-98f5ad3dee20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ad74fef80d4cf68277362e4341a326, user_id=6adb559049184ba293ef4b5de477e277, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.891613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.891613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.894526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64d881-baac-4932-9ac5-98f5ad3dee20 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.895373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:20.897594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:20.930055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1026/2071] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:20 2022] PUT /identity/v3/projects/87ad74fef80d4cf68277362e4341a326/users/6adb559049184ba293ef4b5de477e277/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:20.931625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:20.933116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:20.933778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:20.965051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1046/2072] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:20.966221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:20.995237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:20.996876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.070048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824ae4-5ceb-4870-9676-a19d37ab3314 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.079080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.080343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.080819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.081310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.082500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.085033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.099744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1047/2073] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:21.113503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.113702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1027/2074] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:21.113702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.113702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.119027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f13b2-6563-48df-b2e4-d1a72bc3e938 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.123896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69309dd7-6e19-4cc3-9744-acbd00bd44ff admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.124930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.125911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.126232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.126561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] PATH_INFO: `/v3/projects/b82cd582e25f45e9b3bb4105185beaa5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.127743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82cd582e25f45e9b3bb4105185beaa5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.129675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.129844 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.130576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.130709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.130944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.131568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.133682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.162013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1048/2075] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:21 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:21.162908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.174845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6b07-d583-4523-8af7-0aa50992389b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.179880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.180594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.180921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.181243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] PATH_INFO: `/v3/projects/87ad74fef80d4cf68277362e4341a326/users/6adb559049184ba293ef4b5de477e277/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.183331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ad74fef80d4cf68277362e4341a326, user_id=6adb559049184ba293ef4b5de477e277, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.186480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.190514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:21.194834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82cd582e25f45e9b3bb4105185beaa5', 'request_id': 'req-390c23f0-4f90-486b-991c-7c115395496c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.203340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1049/2076] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:21 2022] PUT /identity/v3/projects/87ad74fef80d4cf68277362e4341a326/users/6adb559049184ba293ef4b5de477e277/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:21.204463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.209407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.214437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82cd582e25f45e9b3bb4105185beaa5', 'request_id': 'req-390c23f0-4f90-486b-991c-7c115395496c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.223287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82cd582e25f45e9b3bb4105185beaa5', 'request_id': 'req-390c23f0-4f90-486b-991c-7c115395496c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.238336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] The token cache is being invalidate because project b82cd582e25f45e9b3bb4105185beaa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:21.238670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.239754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.241864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1028/2077] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:21 2022] DELETE /identity/v3/projects/b82cd582e25f45e9b3bb4105185beaa5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:21.242617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.246722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.287703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597897e-d566-4570-bdcf-dab6f5543830 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.291732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812e96c-8d5e-4cf2-8ae9-1c916b1d1f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.292386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812e96c-8d5e-4cf2-8ae9-1c916b1d1f2f service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.292669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812e96c-8d5e-4cf2-8ae9-1c916b1d1f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.293037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812e96c-8d5e-4cf2-8ae9-1c916b1d1f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.295684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0812e96c-8d5e-4cf2-8ae9-1c916b1d1f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.336192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c23f0-4f90-486b-991c-7c115395496c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.353872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:21.384395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812e96c-8d5e-4cf2-8ae9-1c916b1d1f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.386086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812e96c-8d5e-4cf2-8ae9-1c916b1d1f2f service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.397785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1050/2078] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:21.399784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103a241-21e7-4bad-b719-a7c0008d411a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.400123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103a241-21e7-4bad-b719-a7c0008d411a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.400397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103a241-21e7-4bad-b719-a7c0008d411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.412543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.413337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.413836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.414314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.415102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.417086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.434396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1029/2079] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:21.434942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f103a241-21e7-4bad-b719-a7c0008d411a None None] MFA Rules not processed for user `6adb559049184ba293ef4b5de477e277`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:21.436381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f103a241-21e7-4bad-b719-a7c0008d411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.438569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.440631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.454632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96183b8c-51ca-4181-91de-4e3416976623 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.460533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.461470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.461959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.462311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] PATH_INFO: `/v3/users/11fcb9f265674b6fb117b6d675bb8b52` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.463914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fcb9f265674b6fb117b6d675bb8b52)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.466246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.535409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fcb9f265674b6fb117b6d675bb8b52'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.545403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fcb9f265674b6fb117b6d675bb8b52'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.546674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1051/2080] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:21.547841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103a241-21e7-4bad-b719-a7c0008d411a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.561164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103a241-21e7-4bad-b719-a7c0008d411a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.565188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fcb9f265674b6fb117b6d675bb8b52'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.566163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.566782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.567163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.567436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.568218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.569965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.575155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fcb9f265674b6fb117b6d675bb8b52'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.575866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fcb9f265674b6fb117b6d675bb8b52'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:21.584454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1052/2082] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:21.585710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.587106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.587718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1030/2082] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:21 2022] DELETE /identity/v3/users/11fcb9f265674b6fb117b6d675bb8b52 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:21.588685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.592335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.621527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:21.693791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e734c5d-d345-44f8-bed8-97b703cf67c7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.697709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e02ce-fc6b-4c0f-85be-7e9e040fc3e9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:21.711379 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158e95c-cf28-42e5-b811-8c938f1e8b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.712101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e95c-cf28-42e5-b811-8c938f1e8b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.712380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e95c-cf28-42e5-b811-8c938f1e8b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.712651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158e95c-cf28-42e5-b811-8c938f1e8b58 admin admin] PATH_INFO: `/v3/projects/d008f51663bc43e1a0a580f980a9dcc5/users/5b6efdcfe62749b8a5b9194429b1571b/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.731407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158e95c-cf28-42e5-b811-8c938f1e8b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d008f51663bc43e1a0a580f980a9dcc5, user_id=5b6efdcfe62749b8a5b9194429b1571b, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.734311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158e95c-cf28-42e5-b811-8c938f1e8b58 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.762275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1031/2083] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:21 2022] PUT /identity/v3/projects/d008f51663bc43e1a0a580f980a9dcc5/users/5b6efdcfe62749b8a5b9194429b1571b/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:21.764990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.765373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.765577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.802109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:21.806506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:21.808423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:21.808875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:21.809276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:21.813451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.837358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] MFA Rules not processed for user `5b6efdcfe62749b8a5b9194429b1571b`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:21.840679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.951873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:21.954435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:21.965962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1032/2084] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:21.968154 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:21.972063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:21.974775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1053/2085] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:21.975438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:22.037083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008846d8-6051-44ab-97e4-d6652aa0bb09 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.092103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c64ec4-ba70-4ef2-b5fc-e2ccff98b3bf None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.108886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:22.110003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:22.110293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:22.111077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] PATH_INFO: `/v3/projects/b7ab143324e342f586c9fd82a2a677a6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:22.116554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ab143324e342f586c9fd82a2a677a6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:22.119028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:22.181879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:22.183221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:22.183984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:22.184872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:22.185859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:22.189333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:22.220005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ab143324e342f586c9fd82a2a677a6', 'request_id': 'req-feead92d-e0b2-4d75-a12e-370386f18fb7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.229070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1054/2086] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:21 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:22.230616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:22.234260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ab143324e342f586c9fd82a2a677a6', 'request_id': 'req-feead92d-e0b2-4d75-a12e-370386f18fb7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.251223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:22.256772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ab143324e342f586c9fd82a2a677a6', 'request_id': 'req-feead92d-e0b2-4d75-a12e-370386f18fb7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.288454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] The token cache is being invalidate because project b7ab143324e342f586c9fd82a2a677a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:22.288775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.291017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.298738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1033/2087] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:21 2022] DELETE /identity/v3/projects/b7ab143324e342f586c9fd82a2a677a6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:22.299857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:22.301456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:22.364891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:22.381073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d57f66-197b-43fa-af91-3d1d81bb900d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.390185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:22.391497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:22.391954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:22.392399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:22.394960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:22.431345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feead92d-e0b2-4d75-a12e-370386f18fb7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.534444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:22.536111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:22.547911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1055/2088] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:22.549049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:22.550684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:22.550966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:22.553651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:22.553939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:22.554178 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] PATH_INFO: `/v3/users/3504f4bd593c4fb38dc5e18b69b5f9f0` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:22.555885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3504f4bd593c4fb38dc5e18b69b5f9f0)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:22.559173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:22.570318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe24aa-ffe1-4d94-a322-3c9856f888f4 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.577617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:22.578538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:22.578914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:22.579300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:22.580114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:22.582159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:22.622959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1056/2089] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:22 2022] POST /identity/v3/users => generated 299 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:22.630496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:22.632797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:22.658402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503bce6-79d5-4e9a-ab22-3547139e0e49 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.667536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:22.669174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:22.669840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:22.670237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] PATH_INFO: `/v3/users/7d9bddc501d2449f988064d236fc60a4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:22.671802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9bddc501d2449f988064d236fc60a4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:22.674373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:22.677740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3504f4bd593c4fb38dc5e18b69b5f9f0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.697752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3504f4bd593c4fb38dc5e18b69b5f9f0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.742845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3504f4bd593c4fb38dc5e18b69b5f9f0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.749490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9bddc501d2449f988064d236fc60a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.750445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9bddc501d2449f988064d236fc60a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.767205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3504f4bd593c4fb38dc5e18b69b5f9f0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.768309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3504f4bd593c4fb38dc5e18b69b5f9f0'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.780427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9bddc501d2449f988064d236fc60a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.782120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9bddc501d2449f988064d236fc60a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.795401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1034/2090] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:22 2022] DELETE /identity/v3/users/3504f4bd593c4fb38dc5e18b69b5f9f0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:22.795401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:22.795401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:22.796952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9bddc501d2449f988064d236fc60a4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:22.831510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1057/2091] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:22 2022] DELETE /identity/v3/users/7d9bddc501d2449f988064d236fc60a4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:22.832630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:22.835181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:22.892648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:22.911316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:22.931104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e34e1-ce98-443c-a2ab-5ef503f1353b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.972650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecb1fd-3a17-4c64-8cdc-117e6f920490 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:22.978954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924035ae-d211-46e2-8d62-141baf1255dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:22.980247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924035ae-d211-46e2-8d62-141baf1255dd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:22.980944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924035ae-d211-46e2-8d62-141baf1255dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:22.981297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924035ae-d211-46e2-8d62-141baf1255dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:22.982432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924035ae-d211-46e2-8d62-141baf1255dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:22.984191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924035ae-d211-46e2-8d62-141baf1255dd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.006766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1058/2092] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:23.010701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.011610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.011791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.011904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.012137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.012323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.012689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] PATH_INFO: `/v3/projects/55d8892e763f42da8c554f28b9cf6a71` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.014323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d8892e763f42da8c554f28b9cf6a71)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.017770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.054013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:23.055395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.066059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1059/2093] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:23.066988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:23.068759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.086060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e9bc-5ddb-4e40-b9f3-2f75a62fcf1e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:23.094689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d8892e763f42da8c554f28b9cf6a71', 'request_id': 'req-cd52704e-5528-4418-b414-24e6406bd82f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.106635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d8892e763f42da8c554f28b9cf6a71', 'request_id': 'req-cd52704e-5528-4418-b414-24e6406bd82f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.117448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d8892e763f42da8c554f28b9cf6a71', 'request_id': 'req-cd52704e-5528-4418-b414-24e6406bd82f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.133706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] The token cache is being invalidate because project 55d8892e763f42da8c554f28b9cf6a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:23.134187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.135925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.144015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1035/2094] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:22 2022] DELETE /identity/v3/projects/55d8892e763f42da8c554f28b9cf6a71 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:23.145226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:23.146785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.180065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c1e61-9f73-4451-bbcf-d168ec115be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.181603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c1e61-9f73-4451-bbcf-d168ec115be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.182089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c1e61-9f73-4451-bbcf-d168ec115be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.183698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c1e61-9f73-4451-bbcf-d168ec115be8 admin admin] PATH_INFO: `/v3/projects/e9e766936ec54b00a4b1d97a9f4a3e77/users/730882a1979d4c608ce23c38002f7c06/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.228495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c1e61-9f73-4451-bbcf-d168ec115be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e766936ec54b00a4b1d97a9f4a3e77, user_id=730882a1979d4c608ce23c38002f7c06, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.233028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c1e61-9f73-4451-bbcf-d168ec115be8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.263406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1060/2095] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:23 2022] PUT /identity/v3/projects/e9e766936ec54b00a4b1d97a9f4a3e77/users/730882a1979d4c608ce23c38002f7c06/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:23.263406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.263406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.263406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.280842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52704e-5528-4418-b414-24e6406bd82f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:23.299973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:23.312111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.358294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:23.366333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.367722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.367722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.368083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.372404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.415865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1061/2096] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:23.417028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:23.418689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.446185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54cff-34c5-43e7-ab46-f1bfffa8b3cd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:23.451973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.453276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.454379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.454664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] PATH_INFO: `/v3/projects/71c746acd82e420c919ff322ab9175b4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.455537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.456055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c746acd82e420c919ff322ab9175b4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.457495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.458160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.470821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1036/2097] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:23.472329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:23.473712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.486834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6331e-6102-4a6a-bc16-6b71ae4f5d0b service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:23.492467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30430c-32d2-423e-82b5-a94880ce0fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.493183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30430c-32d2-423e-82b5-a94880ce0fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.493580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30430c-32d2-423e-82b5-a94880ce0fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.494163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30430c-32d2-423e-82b5-a94880ce0fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.495387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30430c-32d2-423e-82b5-a94880ce0fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.497598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30430c-32d2-423e-82b5-a94880ce0fd6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.498668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:23.515270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1037/2098] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:23.517127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c234-7d45-46a8-a5b3-8c93db9fd6a0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.517655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c234-7d45-46a8-a5b3-8c93db9fd6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.517892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c234-7d45-46a8-a5b3-8c93db9fd6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.539454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c746acd82e420c919ff322ab9175b4', 'request_id': 'req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.542476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4d91c234-7d45-46a8-a5b3-8c93db9fd6a0 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:23.544155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4d91c234-7d45-46a8-a5b3-8c93db9fd6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.562273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c746acd82e420c919ff322ab9175b4', 'request_id': 'req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.572179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c746acd82e420c919ff322ab9175b4', 'request_id': 'req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.593671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] The token cache is being invalidate because project 71c746acd82e420c919ff322ab9175b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:23.596047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.596774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:23.598311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1062/2099] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:23 2022] DELETE /identity/v3/projects/71c746acd82e420c919ff322ab9175b4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:23.601225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:23.606156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.636962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1038/2100] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:23.638460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8330-c140-4fb1-9c03-7fedafaede60 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.639411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8330-c140-4fb1-9c03-7fedafaede60 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.639785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8330-c140-4fb1-9c03-7fedafaede60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.665058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-612c8330-c140-4fb1-9c03-7fedafaede60 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:23.666248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-612c8330-c140-4fb1-9c03-7fedafaede60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.684892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1039/2101] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:23.686041 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8330-c140-4fb1-9c03-7fedafaede60 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:23.700279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8330-c140-4fb1-9c03-7fedafaede60 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:23.710509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19476c1f-c3ed-477a-8892-c922db4ea0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.714688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19476c1f-c3ed-477a-8892-c922db4ea0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.715820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19476c1f-c3ed-477a-8892-c922db4ea0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.716478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19476c1f-c3ed-477a-8892-c922db4ea0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.717238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19476c1f-c3ed-477a-8892-c922db4ea0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:23.717621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19476c1f-c3ed-477a-8892-c922db4ea0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.719320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19476c1f-c3ed-477a-8892-c922db4ea0f8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.741813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d62b8d-2cd1-4897-bca4-a3d0eaa6b59c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:23.747510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.748474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1040/2102] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:23.751279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253c12e-d221-4a49-bb4b-c5e09ea89da6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.751918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253c12e-d221-4a49-bb4b-c5e09ea89da6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.752045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.752451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253c12e-d221-4a49-bb4b-c5e09ea89da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.752537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.752801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] PATH_INFO: `/v3/projects/e9e766936ec54b00a4b1d97a9f4a3e77/users/730882a1979d4c608ce23c38002f7c06/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.755456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e766936ec54b00a4b1d97a9f4a3e77, user_id=730882a1979d4c608ce23c38002f7c06, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.759736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.787711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1063/2103] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:23 2022] PUT /identity/v3/projects/e9e766936ec54b00a4b1d97a9f4a3e77/users/730882a1979d4c608ce23c38002f7c06/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:23.787711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:23.800353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8253c12e-d221-4a49-bb4b-c5e09ea89da6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:23.801745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8253c12e-d221-4a49-bb4b-c5e09ea89da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:23.933906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1041/2104] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:23.947388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e132cc-16e0-482f-957f-878f703e4116 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.947701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e132cc-16e0-482f-957f-878f703e4116 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.947977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e132cc-16e0-482f-957f-878f703e4116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.949901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf26dcb-2c09-4d09-a780-06620530de95 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:23.955977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:23.957000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:23.957116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:23.957822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:23.958671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:23.961127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:23.984558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:24.019427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1064/2105] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:23 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:24.019641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-56e132cc-16e0-482f-957f-878f703e4116 None None] MFA Rules not processed for user `730882a1979d4c608ce23c38002f7c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:24.020631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-56e132cc-16e0-482f-957f-878f703e4116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.021634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.123656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:24.206718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad8ee-355c-4448-b94f-4f35f84bf273 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.232589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.232968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.233209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.233536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.238443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:24.238768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.240648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.243397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1042/2106] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:24.245778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e132cc-16e0-482f-957f-878f703e4116 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.278897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e132cc-16e0-482f-957f-878f703e4116 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.280926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1065/2107] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:24.281870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.293901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.299326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.299980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.300256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.300525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.301282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.303417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.331558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533df87-1ad0-45d6-bacd-ded27f7cfc63 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.353776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.355969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.355969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.355969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] PATH_INFO: `/v3/projects/054898f767e84f61863327626ac62f47` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.356668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=054898f767e84f61863327626ac62f47)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.358634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.374161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1043/2108] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:24 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:24.380268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.382079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.494415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054898f767e84f61863327626ac62f47', 'request_id': 'req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.501240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054898f767e84f61863327626ac62f47', 'request_id': 'req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.508596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054898f767e84f61863327626ac62f47', 'request_id': 'req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.546727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] The token cache is being invalidate because project 054898f767e84f61863327626ac62f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:24.546945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.547661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.552314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1066/2109] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:24 2022] DELETE /identity/v3/projects/054898f767e84f61863327626ac62f47 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:24.553244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.555206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.592159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7961-a73b-4134-9375-1bc53b3b1595 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.701790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.702415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7fc84-35a6-44c3-8e8e-cc385e782cfa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.702743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.703082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.703292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.708122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.708349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.708746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.708850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.709083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.709785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.711855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.761037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:24.766497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1067/2110] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:24 2022] POST /identity/v3/projects => generated 409 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:24.768241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.770684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.791955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.793509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.804755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1044/2111] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:24.805507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.806828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.823361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e5c2f-fcf1-4229-9da4-63eef0059d06 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.826535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:24.861622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa314549-4cc4-4975-a1f6-9ae27269a7f2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.868843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.869543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.870144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.870595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.871512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.874128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.888251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1068/2112] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:24.889819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:24.894377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:24.907082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.908514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.909722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.910183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] PATH_INFO: `/v3/users/32af613bff074efa8a8605709d3eb255` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.911885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32af613bff074efa8a8605709d3eb255)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.913365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc1e5-04d0-4121-ab49-01505aca2fec admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:24.914281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.924241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:24.925029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:24.925426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:24.925799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] PATH_INFO: `/v3/users/d8c00927441e47e396ee952361b3a291` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:24.927260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c00927441e47e396ee952361b3a291)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:24.930011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:24.982205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32af613bff074efa8a8605709d3eb255'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.986739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c00927441e47e396ee952361b3a291'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.987688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c00927441e47e396ee952361b3a291'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.991023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32af613bff074efa8a8605709d3eb255'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.995909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c00927441e47e396ee952361b3a291'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:24.996725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c00927441e47e396ee952361b3a291'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.006898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32af613bff074efa8a8605709d3eb255'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.007824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c00927441e47e396ee952361b3a291'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.017054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32af613bff074efa8a8605709d3eb255'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.017935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32af613bff074efa8a8605709d3eb255'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.030617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1045/2113] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:24 2022] DELETE /identity/v3/users/32af613bff074efa8a8605709d3eb255 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:25.030617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.031744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1069/2114] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:24 2022] DELETE /identity/v3/users/d8c00927441e47e396ee952361b3a291 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:25.032569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.033904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.043995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.170656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11167665-0dc0-42a2-ab73-6b689f90d5b6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.186772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.187432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161fcac-d6ec-4070-b737-0dfc58ad3610 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.188141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.188428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.188771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.189525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.194065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.194880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.195806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.196325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.196793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.197648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.199970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.214419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1070/2115] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:25.217520 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:25.218912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.226143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.245529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1046/2116] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:25 2022] POST /identity/v3/users => generated 305 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:25.250673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.280663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeac11-72fa-4fd9-a4f7-d5d4c90b4666 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.285126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652e08-a47c-4409-bcc2-74fc5486d07e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.291136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad9705-8cdf-41d1-9651-e6242fd3cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.291841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9705-8cdf-41d1-9651-e6242fd3cc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.292226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9705-8cdf-41d1-9651-e6242fd3cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.292507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9705-8cdf-41d1-9651-e6242fd3cc7a admin admin] PATH_INFO: `/v3/projects/b3d72e759e1547f783d1f7dd1a6ed736/users/c07c8281837142c7ac3f317fd6d01fff/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.298115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.306261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.306261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.306261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.306261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.306261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.314230 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad9705-8cdf-41d1-9651-e6242fd3cc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d72e759e1547f783d1f7dd1a6ed736, user_id=c07c8281837142c7ac3f317fd6d01fff, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.319010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad9705-8cdf-41d1-9651-e6242fd3cc7a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.335771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1047/2117] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:25.340613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.352140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e43aa5-8972-47c5-b949-748993ed31cf admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.363742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1071/2118] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:25 2022] PUT /identity/v3/projects/b3d72e759e1547f783d1f7dd1a6ed736/users/c07c8281837142c7ac3f317fd6d01fff/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:25.368558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400fb0-8ca0-4dd2-a515-be55444e7998 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.368848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400fb0-8ca0-4dd2-a515-be55444e7998 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.369121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400fb0-8ca0-4dd2-a515-be55444e7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.428012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.430456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.430997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.431435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.432482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3b400fb0-8ca0-4dd2-a515-be55444e7998 None None] MFA Rules not processed for user `c07c8281837142c7ac3f317fd6d01fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:25.433343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.434904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3b400fb0-8ca0-4dd2-a515-be55444e7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.437317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.446209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:25.476507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1048/2119] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:25.477463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.486643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.502389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9dea-698c-426f-92fc-06b90c885b9e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.511106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.512137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.513641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.514299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] PATH_INFO: `/v3/projects/34f55d87942e48a6b2ae2b6fae12dbc5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.515551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f55d87942e48a6b2ae2b6fae12dbc5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.517646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.545416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1072/2120] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:25.547255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400fb0-8ca0-4dd2-a515-be55444e7998 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.566044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400fb0-8ca0-4dd2-a515-be55444e7998 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.574147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f55d87942e48a6b2ae2b6fae12dbc5', 'request_id': 'req-a7fb1184-c20b-4a23-b551-689e4674da86'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.589994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f55d87942e48a6b2ae2b6fae12dbc5', 'request_id': 'req-a7fb1184-c20b-4a23-b551-689e4674da86'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.602948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f55d87942e48a6b2ae2b6fae12dbc5', 'request_id': 'req-a7fb1184-c20b-4a23-b551-689e4674da86'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.620290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] The token cache is being invalidate because project 34f55d87942e48a6b2ae2b6fae12dbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:25.620510 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.622161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.624064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1049/2121] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:25 2022] DELETE /identity/v3/projects/34f55d87942e48a6b2ae2b6fae12dbc5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:25.624904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.626417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.651783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.653016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.653403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.654058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] PATH_INFO: `/v3/projects/cbe256531a9046658f400e883e375a91/users/716e8e584d324102a3694c3e4688b9b6/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.673517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe256531a9046658f400e883e375a91, user_id=716e8e584d324102a3694c3e4688b9b6, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.677747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.694212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1073/2122] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:25 2022] PUT /identity/v3/projects/cbe256531a9046658f400e883e375a91/users/716e8e584d324102a3694c3e4688b9b6/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:25.695059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.696721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.704969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:25.708971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb1184-c20b-4a23-b551-689e4674da86 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.755234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e033da-fed3-4aeb-8cf4-ce64ae76215c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.761342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeddf5a-1db7-40ca-af96-42f66cf3c197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.762760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeddf5a-1db7-40ca-af96-42f66cf3c197 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.763091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeddf5a-1db7-40ca-af96-42f66cf3c197 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.764309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeddf5a-1db7-40ca-af96-42f66cf3c197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.766409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cfeddf5a-1db7-40ca-af96-42f66cf3c197 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.772080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.772835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.773142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.773470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] PATH_INFO: `/v3/projects/176b8372698d45e2b867ea23b67b90cd` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.774652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=176b8372698d45e2b867ea23b67b90cd)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.776638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.827954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:25.834420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176b8372698d45e2b867ea23b67b90cd', 'request_id': 'req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.844003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176b8372698d45e2b867ea23b67b90cd', 'request_id': 'req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.844151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeddf5a-1db7-40ca-af96-42f66cf3c197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.845696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeddf5a-1db7-40ca-af96-42f66cf3c197 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.852512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176b8372698d45e2b867ea23b67b90cd', 'request_id': 'req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.856570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1074/2123] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:25.864369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] The token cache is being invalidate because project 176b8372698d45e2b867ea23b67b90cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:25.864722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.865404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:25.866966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1050/2124] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:25 2022] DELETE /identity/v3/projects/176b8372698d45e2b867ea23b67b90cd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:25.867932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:25.869419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.871930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b70e6-187f-44c5-82b2-55e98bc80911 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.872168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b70e6-187f-44c5-82b2-55e98bc80911 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.872591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b70e6-187f-44c5-82b2-55e98bc80911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.895098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0c3b70e6-187f-44c5-82b2-55e98bc80911 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:25.896477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0c3b70e6-187f-44c5-82b2-55e98bc80911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:25.969373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a715c-e79a-4dc9-8d21-3ff6cd4a93ba admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:25.978179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:25.978987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.980171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.980570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] PATH_INFO: `/v3/users/5b6efdcfe62749b8a5b9194429b1571b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:25.982658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6efdcfe62749b8a5b9194429b1571b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:25.985280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:25.987534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1075/2125] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:25.989713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817b55-7059-4eec-a8e2-f5d7a14660b8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:25.990303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817b55-7059-4eec-a8e2-f5d7a14660b8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:25.990875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817b55-7059-4eec-a8e2-f5d7a14660b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.026868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f4817b55-7059-4eec-a8e2-f5d7a14660b8 None None] MFA Rules not processed for user `716e8e584d324102a3694c3e4688b9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:26.028424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f4817b55-7059-4eec-a8e2-f5d7a14660b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.033922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:26.046022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6efdcfe62749b8a5b9194429b1571b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:26.055084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6efdcfe62749b8a5b9194429b1571b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:26.069789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6efdcfe62749b8a5b9194429b1571b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:26.084908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6efdcfe62749b8a5b9194429b1571b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:26.085610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-17e70a98-3197-49ac-9462-1786f56756e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6efdcfe62749b8a5b9194429b1571b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:26.092967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1051/2126] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:25 2022] DELETE /identity/v3/users/5b6efdcfe62749b8a5b9194429b1571b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:26.097365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec339-e00e-4887-aa47-9cb33302dccd None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.097666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec339-e00e-4887-aa47-9cb33302dccd None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.097845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec339-e00e-4887-aa47-9cb33302dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.118452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-309ec339-e00e-4887-aa47-9cb33302dccd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:26.119698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-309ec339-e00e-4887-aa47-9cb33302dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.122701 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1076/2127] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:26.124095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.124688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.124935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.151713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:26.153690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.206814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1052/2128] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:26.206814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcacf8-0f16-4cf0-94a0-5decaf508ce6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.206814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcacf8-0f16-4cf0-94a0-5decaf508ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.206814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcacf8-0f16-4cf0-94a0-5decaf508ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.238375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1077/2129] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:26.238375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.240868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.241228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9abcacf8-0f16-4cf0-94a0-5decaf508ce6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:26.243049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9abcacf8-0f16-4cf0-94a0-5decaf508ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.252602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1053/2130] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:26.254252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc76d5-08bb-4fc3-b9f5-a16ba5883a96 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.254927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc76d5-08bb-4fc3-b9f5-a16ba5883a96 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.256151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc76d5-08bb-4fc3-b9f5-a16ba5883a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.269827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf47dc-1a6d-474a-bd67-055a7721c45e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.276499 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.277322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.278320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.278771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.279119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-15cc76d5-08bb-4fc3-b9f5-a16ba5883a96 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:26.279797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.280629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-15cc76d5-08bb-4fc3-b9f5-a16ba5883a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.282212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.293495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1054/2131] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:26.293495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc76d5-08bb-4fc3-b9f5-a16ba5883a96 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.323759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc76d5-08bb-4fc3-b9f5-a16ba5883a96 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.331418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.332103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.332371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.332654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.333293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:26.333613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.335344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.338674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:26.355356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1055/2132] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:26.355356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.355356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.373378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1078/2133] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/projects => generated 409 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:26.373378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.422701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2311ea-d8f7-4e8a-90f8-86d9f4875847 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.466442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228067-ca85-4e64-93eb-fea0c1bfdefe admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.470362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:26.472893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.473548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.473827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.474096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.474757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:26.475064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.476912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.480992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.481527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.481995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.482688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.491614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1079/2134] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:26.492297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.500388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.501960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.502894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092492ca-d793-425d-9883-127244cc3664 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.513548 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1056/2135] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:26.515191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.518190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.518816 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.519329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.519633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.520268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.522370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.525192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b62d2-c974-46b7-891c-70157d238069 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.531259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.531910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.532194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.532470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.533112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.535049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.564619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1057/2136] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/users => generated 311 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:26.566085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.566999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1080/2137] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:26.567996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.578811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15463dba-54de-4864-8f6e-1719841dbb5f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.658125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.658783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.659104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.659383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.660070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.661066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c61ca-a078-4273-8ae7-4e4a651a8c8a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.662262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.667766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.668676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.669017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.669503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.670431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.672272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.684679 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1081/2138] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:26.685775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.697718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3d662-a55e-4638-9e00-5b6f980b1a76 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.702769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.702936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1058/2139] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:26.703395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.703684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.703961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.704570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.704670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.706563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.729975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1082/2140] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:26.731120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.743304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342f41-d91b-435d-aff7-f5b5f66fb6d1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.777189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382c390-3096-42f4-bff0-a67cb8e1e979 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.782156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.782893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.783243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.783609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] PATH_INFO: `/v3/projects/d589c6f53d3942db82b8cdca69659844/users/dd1431627ff54d27b0b16db3b4c40dc5/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.799642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:26.807762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d589c6f53d3942db82b8cdca69659844, user_id=dd1431627ff54d27b0b16db3b4c40dc5, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.810762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.819709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.820738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.821191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.821665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.822475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.824744 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.827514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1059/2141] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:26 2022] PUT /identity/v3/projects/d589c6f53d3942db82b8cdca69659844/users/dd1431627ff54d27b0b16db3b4c40dc5/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:26.828159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.850805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1083/2142] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:26 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:26.851892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.863061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d67d-a73c-4a98-aee6-4566c0e91223 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.879637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:26.908586 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4f74c-61ed-4b4d-9d21-5ae5778b630d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.914166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.914807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.915092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.915367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.916051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.917680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.924520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.925264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.925547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.925817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.926460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.927855 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1060/2143] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:26.928078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.931597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.938441 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1084/2144] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:26.939419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.941101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:26.942212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f3302-c482-41a9-b0ca-7316c2b9f707 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.946885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.947490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.947807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.948087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.948812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.950411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.954270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da2a2a-e7bd-4dc9-bfb2-8274c4d4b04b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.958947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.959566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.959877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.960149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] PATH_INFO: `/v3/projects/d008f51663bc43e1a0a580f980a9dcc5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.960648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1061/2145] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:26.961324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:26.964029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d008f51663bc43e1a0a580f980a9dcc5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.966690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.972843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ec208-6da5-4068-b7ae-89527968d2f0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:26.977560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:26.978147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:26.978430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:26.978700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:26.979348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:26.980977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:26.991287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1062/2146] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:26.992087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.004898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe578558-8b2b-432b-8e61-30aea76dcaf7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.015986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd008f51663bc43e1a0a580f980a9dcc5', 'request_id': 'req-fa646295-e27c-42ea-a2ce-086afb550e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.021850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd008f51663bc43e1a0a580f980a9dcc5', 'request_id': 'req-fa646295-e27c-42ea-a2ce-086afb550e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.032339 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd008f51663bc43e1a0a580f980a9dcc5', 'request_id': 'req-fa646295-e27c-42ea-a2ce-086afb550e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.045637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] The token cache is being invalidate because project d008f51663bc43e1a0a580f980a9dcc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:27.045955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.047104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.048661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1085/2147] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:26 2022] DELETE /identity/v3/projects/d008f51663bc43e1a0a580f980a9dcc5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:27.049420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.050715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.064667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.065419 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.065694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.065964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] PATH_INFO: `/v3/projects/d589c6f53d3942db82b8cdca69659844/users/dd1431627ff54d27b0b16db3b4c40dc5/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.068015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d589c6f53d3942db82b8cdca69659844, user_id=dd1431627ff54d27b0b16db3b4c40dc5, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.070685 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.080840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1063/2148] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:26 2022] PUT /identity/v3/projects/d589c6f53d3942db82b8cdca69659844/users/dd1431627ff54d27b0b16db3b4c40dc5/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:27.081596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.083195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.111495 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:27.126267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa646295-e27c-42ea-a2ce-086afb550e10 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.149373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8023a-8fd8-40f6-969f-db414782ef08 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.154537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.155198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.155473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.155769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] PATH_INFO: `/v3/projects/bf32de17f9d14842a78689bc20f3c15c/users/aa5c1b3aaa3f42a190ece5de26a24ca6/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.170371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf32de17f9d14842a78689bc20f3c15c, user_id=aa5c1b3aaa3f42a190ece5de26a24ca6, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.173157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.185331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015190-c1b3-4fe5-8bbc-ec4846eb5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.185955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015190-c1b3-4fe5-8bbc-ec4846eb5470 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.186220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015190-c1b3-4fe5-8bbc-ec4846eb5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.186493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015190-c1b3-4fe5-8bbc-ec4846eb5470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.187133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e015190-c1b3-4fe5-8bbc-ec4846eb5470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.191522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1064/2149] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:27 2022] PUT /identity/v3/projects/bf32de17f9d14842a78689bc20f3c15c/users/aa5c1b3aaa3f42a190ece5de26a24ca6/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:27.191522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.191876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e015190-c1b3-4fe5-8bbc-ec4846eb5470 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.191957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.200704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1086/2150] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:27.202089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef8a1-07f6-4830-b285-33a58dfdd77c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.202468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef8a1-07f6-4830-b285-33a58dfdd77c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.202835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ef8a1-07f6-4830-b285-33a58dfdd77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.223459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:27.232629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e38ef8a1-07f6-4830-b285-33a58dfdd77c None None] MFA Rules not processed for user `dd1431627ff54d27b0b16db3b4c40dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:27.234492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e38ef8a1-07f6-4830-b285-33a58dfdd77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.256886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce019-a56b-4070-96bc-679591433fef admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.261834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.262494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.262776 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.263050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] PATH_INFO: `/v3/users/730882a1979d4c608ce23c38002f7c06` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.264515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=730882a1979d4c608ce23c38002f7c06)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.266481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.317167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1087/2151] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:27.321165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cfb1-4382-42a7-b783-8fd15419ab61 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.321165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cfb1-4382-42a7-b783-8fd15419ab61 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.321165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8cfb1-4382-42a7-b783-8fd15419ab61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.325372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '730882a1979d4c608ce23c38002f7c06'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.333537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '730882a1979d4c608ce23c38002f7c06'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.347722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '730882a1979d4c608ce23c38002f7c06'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.347962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-66a8cfb1-4382-42a7-b783-8fd15419ab61 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:27.349182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-66a8cfb1-4382-42a7-b783-8fd15419ab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.355786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '730882a1979d4c608ce23c38002f7c06'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.357670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '730882a1979d4c608ce23c38002f7c06'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.358990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1088/2152] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:27.359909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cfb1-4382-42a7-b783-8fd15419ab61 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.373206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1065/2153] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:27 2022] DELETE /identity/v3/users/730882a1979d4c608ce23c38002f7c06 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:27.374491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.377219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.386167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8cfb1-4382-42a7-b783-8fd15419ab61 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.458666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f3359-2023-48e2-9bfe-d1ed12fb4990 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.463300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301069f-3786-4728-b2bd-47021945d2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.463959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301069f-3786-4728-b2bd-47021945d2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.464240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301069f-3786-4728-b2bd-47021945d2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.464516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301069f-3786-4728-b2bd-47021945d2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.466482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a301069f-3786-4728-b2bd-47021945d2f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.499073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.500231 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.500547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.501434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] PATH_INFO: `/v3/projects/9d2ed7cf4de94a84a323b20315eeb429/users/9d10e96926244716887477f788eb2bf5/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.525420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2ed7cf4de94a84a323b20315eeb429, user_id=9d10e96926244716887477f788eb2bf5, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.531476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.551602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:27.557808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301069f-3786-4728-b2bd-47021945d2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.560121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301069f-3786-4728-b2bd-47021945d2f3 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.561822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1089/2154] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:27 2022] PUT /identity/v3/projects/9d2ed7cf4de94a84a323b20315eeb429/users/9d10e96926244716887477f788eb2bf5/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:27.571352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.571535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:27.571646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.590310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1066/2155] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:27.592060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.592381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.592590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.642588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] MFA Rules not processed for user `9d10e96926244716887477f788eb2bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:27.644318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.688410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc36083-fbaf-445d-8ebc-ca5a5ed4291c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.698580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.699242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.700181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.700555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.706165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.759433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1067/2156] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:27.772089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.780058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.851845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.853306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.864392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1090/2157] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:27.865266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.866601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.878447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607328-e0ea-4bc9-a879-60673f4dac77 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.884362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:27.885034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:27.885347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:27.885621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] PATH_INFO: `/v3/projects/e9e766936ec54b00a4b1d97a9f4a3e77` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:27.887424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e766936ec54b00a4b1d97a9f4a3e77)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:27.889931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:27.935168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ffc14-a710-4130-8e5d-809936b1d514 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:27.950188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e766936ec54b00a4b1d97a9f4a3e77', 'request_id': 'req-7575d89f-4df9-4ca9-92b8-6101baec6915'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.959671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e766936ec54b00a4b1d97a9f4a3e77', 'request_id': 'req-7575d89f-4df9-4ca9-92b8-6101baec6915'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.967244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e766936ec54b00a4b1d97a9f4a3e77', 'request_id': 'req-7575d89f-4df9-4ca9-92b8-6101baec6915'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.979424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] The token cache is being invalidate because project e9e766936ec54b00a4b1d97a9f4a3e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:27.979751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.980430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:27.982522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1068/2158] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:27 2022] DELETE /identity/v3/projects/e9e766936ec54b00a4b1d97a9f4a3e77 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:27.983333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:27.984705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:27.999452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e6c42-2dc6-4db4-8261-0aaee3e793d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.000234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6c42-2dc6-4db4-8261-0aaee3e793d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.000412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6c42-2dc6-4db4-8261-0aaee3e793d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.000688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6c42-2dc6-4db4-8261-0aaee3e793d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.002674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9e1e6c42-2dc6-4db4-8261-0aaee3e793d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:28.007959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:28.029527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:28.055030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d89f-4df9-4ca9-92b8-6101baec6915 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:28.061349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3258b-6dc6-4def-9373-58f79b5ab666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.062613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3258b-6dc6-4def-9373-58f79b5ab666 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.063203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3258b-6dc6-4def-9373-58f79b5ab666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.064088 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3258b-6dc6-4def-9373-58f79b5ab666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.066577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-cfa3258b-6dc6-4def-9373-58f79b5ab666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:28.090402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e6c42-2dc6-4db4-8261-0aaee3e793d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.092209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e6c42-2dc6-4db4-8261-0aaee3e793d7 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.101867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1091/2159] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:28.103370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9907bb-0516-49ea-bbf3-28957c52b770 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.103884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9907bb-0516-49ea-bbf3-28957c52b770 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.104380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9907bb-0516-49ea-bbf3-28957c52b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.128054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bd9907bb-0516-49ea-bbf3-28957c52b770 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:28.129593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bd9907bb-0516-49ea-bbf3-28957c52b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:28.136273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3258b-6dc6-4def-9373-58f79b5ab666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.137943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3258b-6dc6-4def-9373-58f79b5ab666 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.150276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1069/2160] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:28.211718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1092/2161] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:28.216430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3306-623f-40d9-bfd4-612805e185b8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.216734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3306-623f-40d9-bfd4-612805e185b8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.217006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3306-623f-40d9-bfd4-612805e185b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.246307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-14be3306-623f-40d9-bfd4-612805e185b8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:28.247963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-14be3306-623f-40d9-bfd4-612805e185b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:28.257921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1070/2162] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:28.262809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9907bb-0516-49ea-bbf3-28957c52b770 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:28.275861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9907bb-0516-49ea-bbf3-28957c52b770 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:28.289330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.289961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.290239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.290506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.291165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:28.291465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.293251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.335106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1093/2163] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:28.340507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be3306-623f-40d9-bfd4-612805e185b8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:28.350828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be3306-623f-40d9-bfd4-612805e185b8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:28.356174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.357100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.357100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.357361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.357949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.360680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.401955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1071/2164] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:28 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:28.406705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:28.424323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b8d8-cf83-47f8-b969-9dd680cd8b66 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:28.505754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.507514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.508034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.508475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.509426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.512147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.553280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:28.565962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1094/2165] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:28 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:28.567682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72f3e8-c2c4-4691-8c60-4e23fe5373b3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:28.576584 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.577193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.579409 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.579750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.581529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.583759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.601661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:28.602097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1072/2166] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:28.613693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3d79-0af7-4339-8ef0-998454cac5dd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:28.623710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab8d76-e1a7-4d1a-b705-69c50bbac753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.624937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab8d76-e1a7-4d1a-b705-69c50bbac753 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.625691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab8d76-e1a7-4d1a-b705-69c50bbac753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.625691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab8d76-e1a7-4d1a-b705-69c50bbac753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.626524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab8d76-e1a7-4d1a-b705-69c50bbac753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.630810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab8d76-e1a7-4d1a-b705-69c50bbac753 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.654477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:28.655064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1095/2167] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:28.677390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5a1d1-7779-4cf8-bd10-8eadd8846f83 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:28.688312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:28.698724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.699032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.699359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] PATH_INFO: `/v3/projects/9c995579160b4541abc7825354a5cd1a/users/f2448018820b47eaa95a42903fe85693/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.731983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c995579160b4541abc7825354a5cd1a, user_id=f2448018820b47eaa95a42903fe85693, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:28.738342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:28.765309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1073/2168] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:28 2022] PUT /identity/v3/projects/9c995579160b4541abc7825354a5cd1a/users/f2448018820b47eaa95a42903fe85693/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:28.774296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6393-cf16-41e5-b7a5-a0c8314c776f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:28.774705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6393-cf16-41e5-b7a5-a0c8314c776f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:28.775304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6393-cf16-41e5-b7a5-a0c8314c776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:28.802140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-35ac6393-cf16-41e5-b7a5-a0c8314c776f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:28.803486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-35ac6393-cf16-41e5-b7a5-a0c8314c776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:28.843344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:28.932964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1096/2169] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:28.945684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:28.947743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:29.041045 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bba3f4-597f-4e61-9b52-01ab021eb949 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:29.045830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:29.046447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:29.046727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:29.046997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:29.068748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:29.070331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:29.085187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1074/2170] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:30.629303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce5a2-9436-44e3-8899-9d34bffc2857 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:30.629899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce5a2-9436-44e3-8899-9d34bffc2857 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:30.629992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce5a2-9436-44e3-8899-9d34bffc2857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:30.677004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-bd7ce5a2-9436-44e3-8899-9d34bffc2857 None None] MFA Rules not processed for user `f2448018820b47eaa95a42903fe85693`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:30.679252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bd7ce5a2-9436-44e3-8899-9d34bffc2857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:30.790284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1097/2171] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:30.791284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:30.803566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db626-d283-4d0c-bc04-9361ff197374 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:30.814681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:30.815699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:30.815699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:30.815868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:30.816649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:30.818845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:30.830736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:30.869993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce5a2-9436-44e3-8899-9d34bffc2857 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:30.870203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1075/2172] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:30 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:30.891398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce5a2-9436-44e3-8899-9d34bffc2857 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:30.996448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:30.997549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:30.997860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:30.998206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:30.999037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:31.003202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:31.031985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1098/2173] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:30 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:31.037264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:31.051323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a5b1-aac8-4e56-a175-e31819b8042a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:31.056589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:31.057645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:31.058124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:31.058603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:31.059499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:31.062373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:31.093322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1076/2174] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:31.094837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:31.108401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c46a4-66cf-4f37-bc9b-f1cef9754989 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:31.114019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:31.114762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:31.115109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:31.115741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] PATH_INFO: `/v3/projects/b697d0e7ce5e44a48fefa67f23aa29ee/users/8a6948525b0e4302a8a874f1371a8fd5/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:31.134822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b697d0e7ce5e44a48fefa67f23aa29ee, user_id=8a6948525b0e4302a8a874f1371a8fd5, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:31.138183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:31.160085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1099/2175] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:31 2022] PUT /identity/v3/projects/b697d0e7ce5e44a48fefa67f23aa29ee/users/8a6948525b0e4302a8a874f1371a8fd5/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:31.164717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:31.180351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09324e3-d8f8-40ac-bb92-bc5bccf57a95 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:31.296922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:31.298166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:31.298616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:31.299119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:31.307492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:31.309426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:31.329357 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1077/2176] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:31.330364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:31.345850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be8980-e620-40e3-9738-6cc190335975 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:31.357283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:31.360010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:31.360754 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:31.364369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] PATH_INFO: `/v3/projects/b697d0e7ce5e44a48fefa67f23aa29ee/users/8a6948525b0e4302a8a874f1371a8fd5/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:31.370463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b697d0e7ce5e44a48fefa67f23aa29ee, user_id=8a6948525b0e4302a8a874f1371a8fd5, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:31.374452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:31.415258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1100/2177] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:31 2022] PUT /identity/v3/projects/b697d0e7ce5e44a48fefa67f23aa29ee/users/8a6948525b0e4302a8a874f1371a8fd5/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:31.719460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:31.721969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:31.738753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e5c8f-188c-4687-abd3-c64717aaae23 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:31.904176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:31.905048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:31.905391 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:31.905890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] PATH_INFO: `/v3/users/a902177cf8254c3fa89e740e63ebe463` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:31.908187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a902177cf8254c3fa89e740e63ebe463)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:31.911465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:31.955672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:31.957947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:31.978044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c1cf2-68d1-4a46-abe1-064ab3ecbc04 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:31.987702 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:31.988367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:31.988668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:31.989289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] PATH_INFO: `/v3/users/c07c8281837142c7ac3f317fd6d01fff` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:31.991554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07c8281837142c7ac3f317fd6d01fff)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:31.994684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:31.997361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:32.007627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a902177cf8254c3fa89e740e63ebe463'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.026082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a902177cf8254c3fa89e740e63ebe463'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.053169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a902177cf8254c3fa89e740e63ebe463'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.056797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:32.068324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a902177cf8254c3fa89e740e63ebe463'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.069058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f237013f-878c-4134-a067-4657fe2be4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a902177cf8254c3fa89e740e63ebe463'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.078156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07c8281837142c7ac3f317fd6d01fff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.078504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1078/2178] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:31 2022] DELETE /identity/v3/users/a902177cf8254c3fa89e740e63ebe463 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:32.078968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07c8281837142c7ac3f317fd6d01fff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.082605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:32.082891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:32.083162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:32.092094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07c8281837142c7ac3f317fd6d01fff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.092882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07c8281837142c7ac3f317fd6d01fff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.102749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-2a83c0a6-18d4-43ab-9e6c-9858ab42c485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07c8281837142c7ac3f317fd6d01fff'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:32.108891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:32.110508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:32.132174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1101/2179] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:31 2022] DELETE /identity/v3/users/c07c8281837142c7ac3f317fd6d01fff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:32.134257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:32.134692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:32.135135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:32.165654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:32.167731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:32.197128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1079/2180] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:32.208028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:32.210353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:32.255673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1102/2181] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:32.269636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:32.272395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:32.306704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad03fcf-7a69-4fa2-9a9c-6fcd202d4851 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:32.372538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c4a0c-900b-4563-a625-1e95d3c9b167 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:32.377424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235a7cf-4f2c-45ce-8473-2dfa3182e56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:32.378355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a7cf-4f2c-45ce-8473-2dfa3182e56c service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:32.378880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a7cf-4f2c-45ce-8473-2dfa3182e56c service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:32.379297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235a7cf-4f2c-45ce-8473-2dfa3182e56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:32.387734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af3fac-8133-45a2-a442-bee22869cd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:32.388555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af3fac-8133-45a2-a442-bee22869cd0e service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:32.388915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af3fac-8133-45a2-a442-bee22869cd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:32.389806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af3fac-8133-45a2-a442-bee22869cd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:32.394464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235a7cf-4f2c-45ce-8473-2dfa3182e56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:32.396381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235a7cf-4f2c-45ce-8473-2dfa3182e56c service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:32.404949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af3fac-8133-45a2-a442-bee22869cd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:32.406540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af3fac-8133-45a2-a442-bee22869cd0e service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:32.437103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1103/2182] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:32.438474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1080/2183] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:32.721881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:32.722477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:32.722857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:32.794781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] MFA Rules not processed for user `8a6948525b0e4302a8a874f1371a8fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:32.797633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:32.812563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:32.957087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1104/2184] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:32.968924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:32.969870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:32.973516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:32.978496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:32.982767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.004746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] MFA Rules not processed for user `f2448018820b47eaa95a42903fe85693`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:33.007356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.026099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d300d-84cc-4723-8e0f-cb32a495c5ca None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:33.040187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:33.040969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.041261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.041544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] PATH_INFO: `/v3/projects/55d34ce96e6c4960970ce22d59d4b0e7` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.044995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d34ce96e6c4960970ce22d59d4b0e7)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:33.046986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:33.153480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:33.156775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d34ce96e6c4960970ce22d59d4b0e7', 'request_id': 'req-114d6e5a-292b-40be-baa2-510e03e2973e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.170782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d34ce96e6c4960970ce22d59d4b0e7', 'request_id': 'req-114d6e5a-292b-40be-baa2-510e03e2973e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.179335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1081/2185] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:33.179335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:33.181179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.184023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d34ce96e6c4960970ce22d59d4b0e7', 'request_id': 'req-114d6e5a-292b-40be-baa2-510e03e2973e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.205331 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b4a3b-e3b6-4df8-bd6c-638c8d0a890c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:33.209809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] The token cache is being invalidate because project 55d34ce96e6c4960970ce22d59d4b0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:33.210104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.210799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.227142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1105/2186] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:32 2022] DELETE /identity/v3/projects/55d34ce96e6c4960970ce22d59d4b0e7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:33.227142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:33.227657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.290101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:33.290815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.291090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.291361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] PATH_INFO: `/v3/projects/b3d72e759e1547f783d1f7dd1a6ed736` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.292582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d72e759e1547f783d1f7dd1a6ed736)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:33.295049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:33.391226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d6e5a-292b-40be-baa2-510e03e2973e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:33.411481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d72e759e1547f783d1f7dd1a6ed736', 'request_id': 'req-e12edfd0-a976-409e-ba59-a8f8f9706824'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.430385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:33.433462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d72e759e1547f783d1f7dd1a6ed736', 'request_id': 'req-e12edfd0-a976-409e-ba59-a8f8f9706824'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.448255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d72e759e1547f783d1f7dd1a6ed736', 'request_id': 'req-e12edfd0-a976-409e-ba59-a8f8f9706824'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.470615 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] The token cache is being invalidate because project b3d72e759e1547f783d1f7dd1a6ed736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:33.472274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.474069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.482926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1082/2187] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:33 2022] DELETE /identity/v3/projects/b3d72e759e1547f783d1f7dd1a6ed736 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:33.484112 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:33.485695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.490030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a0149-157a-4bd6-bf43-69b351341521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:33.490905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0149-157a-4bd6-bf43-69b351341521 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.491371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0149-157a-4bd6-bf43-69b351341521 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.491838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a0149-157a-4bd6-bf43-69b351341521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.493944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0a0a0149-157a-4bd6-bf43-69b351341521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.570881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a0149-157a-4bd6-bf43-69b351341521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:33.573395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a0149-157a-4bd6-bf43-69b351341521 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:33.579703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12edfd0-a976-409e-ba59-a8f8f9706824 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:33.586016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1106/2188] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:33.586290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f890fa-eb01-479e-b5b7-34ef3c2f7234 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.586665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f890fa-eb01-479e-b5b7-34ef3c2f7234 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.586798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:33.587105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f890fa-eb01-479e-b5b7-34ef3c2f7234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.587458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.587773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.588057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] PATH_INFO: `/v3/users/6adb559049184ba293ef4b5de477e277` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.589381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6adb559049184ba293ef4b5de477e277)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:33.591765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:33.608539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e2f890fa-eb01-479e-b5b7-34ef3c2f7234 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:33.609806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e2f890fa-eb01-479e-b5b7-34ef3c2f7234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.618836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1107/2189] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:33.628113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a67b9d-f508-428f-bd04-b9c1cb313bc7 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.628472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a67b9d-f508-428f-bd04-b9c1cb313bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.628811 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a67b9d-f508-428f-bd04-b9c1cb313bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.642902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:33.658778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c4a67b9d-f508-428f-bd04-b9c1cb313bc7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:33.661548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c4a67b9d-f508-428f-bd04-b9c1cb313bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.673205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6adb559049184ba293ef4b5de477e277'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.675718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1108/2190] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:33.682331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a67b9d-f508-428f-bd04-b9c1cb313bc7 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:33.691551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6adb559049184ba293ef4b5de477e277'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.698380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a67b9d-f508-428f-bd04-b9c1cb313bc7 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:33.705462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:33.706155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6adb559049184ba293ef4b5de477e277'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.706380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.706506 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.706695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.707344 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:33.707882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:33.709801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:33.717726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6adb559049184ba293ef4b5de477e277'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.719195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6adb559049184ba293ef4b5de477e277'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:33.728213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1109/2192] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:40:33.729182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:33.730460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1083/2192] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:33 2022] DELETE /identity/v3/users/6adb559049184ba293ef4b5de477e277 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:33.731489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:33.744981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4d9d3-e23b-4289-bca8-d8f384a0cfc2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:33.866225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:33.867061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:33.867476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:33.867899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:33.868727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:33.882783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:33.957616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1110/2193] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:33 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:33.958236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:33.974303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a6d81-2691-40e8-b387-cdd8d0025024 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:34.102481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:34.103234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:34.103562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:34.105048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:34.105953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:34.109097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:34.155120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:34.166658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1084/2194] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:33 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:34.171386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbd9ce-a564-4f5c-8131-495604283add admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:34.184819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:34.185511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:34.185807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:34.186071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:34.190812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:34.192500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:34.218791 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1111/2195] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:34.223092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:34.241479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab22bae-7d43-41af-b910-2bb18fbfe399 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:34.257585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe58a1f-e145-436d-94af-b3ae4beeb5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:34.258648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe58a1f-e145-436d-94af-b3ae4beeb5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:34.259722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe58a1f-e145-436d-94af-b3ae4beeb5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:34.260170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe58a1f-e145-436d-94af-b3ae4beeb5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:34.261549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe58a1f-e145-436d-94af-b3ae4beeb5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:34.266180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe58a1f-e145-436d-94af-b3ae4beeb5a8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:34.316458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1085/2196] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:34.320635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:34.338789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9413e-9dcd-48d5-939c-a403efed0574 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:34.356557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:34.357261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:34.357541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:34.357815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] PATH_INFO: `/v3/projects/358aa1d7ff2e4bdbbb01ca08774b636a/users/f564df75a4df4613ad8a8a1336ce5702/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:34.400640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:34.416906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] RBAC: Authorizing `identity:create_grant(project_id=358aa1d7ff2e4bdbbb01ca08774b636a, user_id=f564df75a4df4613ad8a8a1336ce5702, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:34.420268 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:34.463546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1112/2197] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:34 2022] PUT /identity/v3/projects/358aa1d7ff2e4bdbbb01ca08774b636a/users/f564df75a4df4613ad8a8a1336ce5702/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:34.475186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:34.475515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:34.475788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:34.588133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:34.589905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:34.590405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] MFA Rules not processed for user `f564df75a4df4613ad8a8a1336ce5702`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:34.594557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:34.817412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc113a-f3d5-4e6d-b49f-f7570a2d901f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:34.832949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:34.833685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:34.834033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:34.834440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] PATH_INFO: `/v3/projects/87ad74fef80d4cf68277362e4341a326` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:34.835830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ad74fef80d4cf68277362e4341a326)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:34.838304 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:34.850217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1086/2198] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:34.855009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:34.856740 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:34.874452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a732f-730e-42f4-8f36-520f93bf71c8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:34.883884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:34.886623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:34.886908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:34.887195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] PATH_INFO: `/v3/users/716e8e584d324102a3694c3e4688b9b6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:34.889660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716e8e584d324102a3694c3e4688b9b6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:34.892743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:34.911952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ad74fef80d4cf68277362e4341a326', 'request_id': 'req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:34.915905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:34.937508 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ad74fef80d4cf68277362e4341a326', 'request_id': 'req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:34.945033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ad74fef80d4cf68277362e4341a326', 'request_id': 'req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:34.968051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] The token cache is being invalidate because project 87ad74fef80d4cf68277362e4341a326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:34.969146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:34.969996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:34.971800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1113/2199] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:34 2022] DELETE /identity/v3/projects/87ad74fef80d4cf68277362e4341a326 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:34.976154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:34.977757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:34.978794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716e8e584d324102a3694c3e4688b9b6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:34.988404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716e8e584d324102a3694c3e4688b9b6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:35.008570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716e8e584d324102a3694c3e4688b9b6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:35.018885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716e8e584d324102a3694c3e4688b9b6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:35.020069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff212098-fb1c-4347-8af0-5e0c1d2018e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716e8e584d324102a3694c3e4688b9b6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:35.028025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1087/2200] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:34 2022] DELETE /identity/v3/users/716e8e584d324102a3694c3e4688b9b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:35.029727 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a7e16-597d-44ed-a33a-9abe213eeb68 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.030260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a7e16-597d-44ed-a33a-9abe213eeb68 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.030542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a7e16-597d-44ed-a33a-9abe213eeb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.067717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-098a7e16-597d-44ed-a33a-9abe213eeb68 None None] MFA Rules not processed for user `aa5c1b3aaa3f42a190ece5de26a24ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:35.069039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-098a7e16-597d-44ed-a33a-9abe213eeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.069410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f10e9d-6b96-45a3-84fc-6c0f22e80901 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:35.113664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:35.142319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec3cdc-a1b8-44c3-bdeb-fb74ed3c4b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:35.143116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec3cdc-a1b8-44c3-bdeb-fb74ed3c4b41 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.143555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec3cdc-a1b8-44c3-bdeb-fb74ed3c4b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.143684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec3cdc-a1b8-44c3-bdeb-fb74ed3c4b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.145494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-07ec3cdc-a1b8-44c3-bdeb-fb74ed3c4b41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.174591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1088/2201] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:35.174591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b513d2e-39c7-4b34-b66f-0e5ea5cc3dfb None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.174591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b513d2e-39c7-4b34-b66f-0e5ea5cc3dfb None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.174591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b513d2e-39c7-4b34-b66f-0e5ea5cc3dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.195883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6b513d2e-39c7-4b34-b66f-0e5ea5cc3dfb None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:35.197220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6b513d2e-39c7-4b34-b66f-0e5ea5cc3dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.260536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec3cdc-a1b8-44c3-bdeb-fb74ed3c4b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:35.262383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec3cdc-a1b8-44c3-bdeb-fb74ed3c4b41 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:35.267932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1089/2202] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:35.273208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a6da-8c63-47da-bc0c-bf950f4fbdee None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.273669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a6da-8c63-47da-bc0c-bf950f4fbdee None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.274171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a6da-8c63-47da-bc0c-bf950f4fbdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.274664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1114/2203] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:35.276013 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.276371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.276714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.303044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2a82a6da-8c63-47da-bc0c-bf950f4fbdee None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:35.304362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2a82a6da-8c63-47da-bc0c-bf950f4fbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.316163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1090/2204] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:35.317147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] MFA Rules not processed for user `aa5c1b3aaa3f42a190ece5de26a24ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:35.317574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.317942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.318380 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.318476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.328265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1115/2205] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:35.329402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:35.331075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.358683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:35.360309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.372436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1091/2206] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:35.376304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:35.379381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:35.390184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:35.476110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d900e-22ad-4e1d-86fe-094a342452f8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:35.483725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c57b-072c-468e-8919-77bb0c6dd28f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:35.490716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:35.491477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.491890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.492001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:35.492436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.493411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.493937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.494621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.503298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:35.505705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:35.518647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1092/2207] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:35.519670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:35.519789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:35.522840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:35.531976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e757b-b736-44bd-bf10-2d5038c9636d service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:35.540463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:35.541222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.541660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.542447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.542796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:35.544307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:35.546168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:35.549883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1116/2208] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:35.563106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1093/2209] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:35.571051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:35.595554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51e58e-f87c-4d20-9727-530ab3cca407 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:35.608613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:35.610169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.610456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.610730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.611370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:35.618362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:35.670842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:35.673429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1117/2210] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:35 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:35.696039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c626c-9153-4cd2-9f17-eed376b483a4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:35.841039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:35.841739 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.841943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.842216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.842862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:35.844923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:35.898801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1094/2211] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:35 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:35.900659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:35.918614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb144dcf-403d-4702-bd29-7455e3963d37 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:35.937021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:35.942536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:35.942536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:35.942536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:35.942536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:35.942536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:35.970887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1118/2212] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:35.975040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:35.994976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964753-d67c-4e46-a72f-3b211268b846 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.002701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702944-27b8-4aaa-979d-2c388b6484f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.003846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702944-27b8-4aaa-979d-2c388b6484f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.004519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702944-27b8-4aaa-979d-2c388b6484f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.005128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702944-27b8-4aaa-979d-2c388b6484f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.006303 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702944-27b8-4aaa-979d-2c388b6484f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.010179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702944-27b8-4aaa-979d-2c388b6484f6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.028556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1095/2213] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:36.033471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:36.046020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61eb36-de96-4f37-930e-002548d9f944 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.052827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.053953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.054486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.054992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] PATH_INFO: `/v3/projects/1336dc180d0e4d6cbf4158e8db76ac79/users/5e872dd8eb8e4c9dbd98785aaa1e1031/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.078870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1336dc180d0e4d6cbf4158e8db76ac79, user_id=5e872dd8eb8e4c9dbd98785aaa1e1031, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.082112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.107192 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1119/2214] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:36 2022] PUT /identity/v3/projects/1336dc180d0e4d6cbf4158e8db76ac79/users/5e872dd8eb8e4c9dbd98785aaa1e1031/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:36.117650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f062-8a4b-453d-926d-581f7a024819 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.118196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f062-8a4b-453d-926d-581f7a024819 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.118513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f062-8a4b-453d-926d-581f7a024819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.128584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:36.130353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:36.173783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e400f062-8a4b-453d-926d-581f7a024819 None None] MFA Rules not processed for user `5e872dd8eb8e4c9dbd98785aaa1e1031`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:36.178174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e400f062-8a4b-453d-926d-581f7a024819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:36.182931 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:36.231723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7f259-4a3e-4304-999e-50c109f2b0fb admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.246543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.247797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.248568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.248947 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] PATH_INFO: `/v3/projects/cbe256531a9046658f400e883e375a91` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.250987 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe256531a9046658f400e883e375a91)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.254025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.280229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:36.319714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1096/2215] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:36.321253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f062-8a4b-453d-926d-581f7a024819 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:36.322093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe256531a9046658f400e883e375a91', 'request_id': 'req-42b6074a-baea-4314-aeec-4beb227f43dd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.328601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe256531a9046658f400e883e375a91', 'request_id': 'req-42b6074a-baea-4314-aeec-4beb227f43dd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.333611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f062-8a4b-453d-926d-581f7a024819 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.335247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe256531a9046658f400e883e375a91', 'request_id': 'req-42b6074a-baea-4314-aeec-4beb227f43dd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.351960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] The token cache is being invalidate because project cbe256531a9046658f400e883e375a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:36.352420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.353186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.355314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1120/2216] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:36 2022] DELETE /identity/v3/projects/cbe256531a9046658f400e883e375a91 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:36.359982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:36.361818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:36.413103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.415175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.415558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.416218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.416975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.419854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.446443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6074a-baea-4314-aeec-4beb227f43dd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.454248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.455337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.455487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.455797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] PATH_INFO: `/v3/users/dd1431627ff54d27b0b16db3b4c40dc5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.457738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1431627ff54d27b0b16db3b4c40dc5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.459802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.464277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1097/2217] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:36 2022] POST /identity/v3/projects => generated 389 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:36.468425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:36.472018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:36.544885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1431627ff54d27b0b16db3b4c40dc5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.545697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1431627ff54d27b0b16db3b4c40dc5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.560212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1431627ff54d27b0b16db3b4c40dc5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.561176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1431627ff54d27b0b16db3b4c40dc5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.569192 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:36.572378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaed261-81df-4a92-87c3-cc59857a339e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.576411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1431627ff54d27b0b16db3b4c40dc5'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:36.582235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.583065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.583529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.583933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.584707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.588285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.611434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1121/2218] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:36 2022] DELETE /identity/v3/users/dd1431627ff54d27b0b16db3b4c40dc5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:36.625661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1098/2219] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:36 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:36.630418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:36.632094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:36.759841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ee450-eda1-4452-9930-91f1b20afc56 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.765723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e8db5-82fb-4311-aee5-8a1a88813326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.766420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e8db5-82fb-4311-aee5-8a1a88813326 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.766703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e8db5-82fb-4311-aee5-8a1a88813326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.767115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e8db5-82fb-4311-aee5-8a1a88813326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.767903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e8db5-82fb-4311-aee5-8a1a88813326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.769772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e8db5-82fb-4311-aee5-8a1a88813326 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.785548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1122/2220] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:36.787571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:36.802050 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b97a-ada9-4a46-9d9a-356efaaca2e0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:36.808405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:36.809550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.810776 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.811452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] PATH_INFO: `/v3/projects/b6a7322d368e4aa4af0b4fa887462bdf/users/9c78f99058c04330baa3bb878a83ea92/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.815259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838080a4-9c00-4214-848c-ce968be7ea3c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:36.815551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838080a4-9c00-4214-848c-ce968be7ea3c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:36.815855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838080a4-9c00-4214-848c-ce968be7ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:36.838431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a7322d368e4aa4af0b4fa887462bdf, user_id=9c78f99058c04330baa3bb878a83ea92, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:36.849324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:36.860609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-838080a4-9c00-4214-848c-ce968be7ea3c None None] MFA Rules not processed for user `aa5c1b3aaa3f42a190ece5de26a24ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:36.867941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-838080a4-9c00-4214-848c-ce968be7ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:36.895305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1099/2221] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:36 2022] PUT /identity/v3/projects/b6a7322d368e4aa4af0b4fa887462bdf/users/9c78f99058c04330baa3bb878a83ea92/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:36.900151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:37.034786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:37.072770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1123/2222] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:37.074899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc19f-dec1-4d57-b61c-e3266cb0d8a2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.075825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc19f-dec1-4d57-b61c-e3266cb0d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.076108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc19f-dec1-4d57-b61c-e3266cb0d8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.094358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52eec-c4f6-4cd5-927b-02e29602df88 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:37.099657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:37.100278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.100554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.100825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.101604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:37.103525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:37.122340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1100/2223] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:37.126525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:37.133131 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a82fc19f-dec1-4d57-b61c-e3266cb0d8a2 None None] MFA Rules not processed for user `f564df75a4df4613ad8a8a1336ce5702`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:37.138411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a82fc19f-dec1-4d57-b61c-e3266cb0d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:37.149835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdddd26-3a8a-421f-89a9-537441702af2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:37.164498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:37.167162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.167522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.168361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] PATH_INFO: `/v3/projects/b6a7322d368e4aa4af0b4fa887462bdf/users/9c78f99058c04330baa3bb878a83ea92/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.188960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a7322d368e4aa4af0b4fa887462bdf, user_id=9c78f99058c04330baa3bb878a83ea92, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:37.212113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:37.248197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1101/2224] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:37 2022] PUT /identity/v3/projects/b6a7322d368e4aa4af0b4fa887462bdf/users/9c78f99058c04330baa3bb878a83ea92/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:37.249408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:37.256278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:37.361909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1124/2225] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:37.361909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.361909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.361909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.423654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84966a-3966-424b-b69c-90b33dbacac4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:37.435018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:37.437827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.438219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.438599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] PATH_INFO: `/v3/projects/d589c6f53d3942db82b8cdca69659844` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.442107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d589c6f53d3942db82b8cdca69659844)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:37.446820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:37.489624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] MFA Rules not processed for user `9c78f99058c04330baa3bb878a83ea92`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:37.493280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:37.533388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:37.565952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd589c6f53d3942db82b8cdca69659844', 'request_id': 'req-99d3126d-2b26-439b-8863-6e37757d110c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:37.579375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd589c6f53d3942db82b8cdca69659844', 'request_id': 'req-99d3126d-2b26-439b-8863-6e37757d110c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:37.592465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd589c6f53d3942db82b8cdca69659844', 'request_id': 'req-99d3126d-2b26-439b-8863-6e37757d110c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:37.642667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] The token cache is being invalidate because project d589c6f53d3942db82b8cdca69659844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:37.643308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:37.648030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-99d3126d-2b26-439b-8863-6e37757d110c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:37.653799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1102/2226] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:37 2022] DELETE /identity/v3/projects/d589c6f53d3942db82b8cdca69659844 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:37.654568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1125/2227] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:37.668843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:37.682601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:37.682731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077d50-6bb1-4716-aef6-4d456bf80f81 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.682731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077d50-6bb1-4716-aef6-4d456bf80f81 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.682731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077d50-6bb1-4716-aef6-4d456bf80f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.768656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-00077d50-6bb1-4716-aef6-4d456bf80f81 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:37.769978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-00077d50-6bb1-4716-aef6-4d456bf80f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:37.808764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de3fde-2973-44b5-b320-3f5e270099a6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:37.881842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:37.928443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1103/2228] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:37.930951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:37.931640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.932060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.932299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.934779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:37.935795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b71c5-b86f-4cf9-aa60-4118af2ec56d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:37.936132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b71c5-b86f-4cf9-aa60-4118af2ec56d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:37.936655 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b71c5-b86f-4cf9-aa60-4118af2ec56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:37.972119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0f3b71c5-b86f-4cf9-aa60-4118af2ec56d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:37.974423 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0f3b71c5-b86f-4cf9-aa60-4118af2ec56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:37.991508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1104/2229] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:37.992595 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b71c5-b86f-4cf9-aa60-4118af2ec56d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.002824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b71c5-b86f-4cf9-aa60-4118af2ec56d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.011228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:38.012417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.013836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.014608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.015488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:38.016219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.018193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.037033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1105/2230] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:38.041916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.043556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.045774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.057505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd08d-11b6-4259-ba51-71da00d63143 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.063094 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1126/2231] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:38.065182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:38.066566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.066953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.067361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.068821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.071460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.128754 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1106/2232] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:38 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:38.130620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.149932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367c1f5-3f76-48eb-9580-c92ef5085e63 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.174491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:38.228111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.229908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:38.304528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:38.306405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.306825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.306951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.307550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.310410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.375907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07267de9-0919-426d-ad0c-38fb7735b1b2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.381484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:38.382298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.382841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.383239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] PATH_INFO: `/v3/users/5e872dd8eb8e4c9dbd98785aaa1e1031` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.384634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e872dd8eb8e4c9dbd98785aaa1e1031)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.386766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.390461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1127/2233] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:38 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:38.392597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.429269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1ee2-d5a5-46ee-a573-4700d3e69c9e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.449598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:38.450039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e872dd8eb8e4c9dbd98785aaa1e1031'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:38.450608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.453587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.454059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.457523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.466093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.466744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e872dd8eb8e4c9dbd98785aaa1e1031'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:38.482845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e872dd8eb8e4c9dbd98785aaa1e1031'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:38.495190 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e872dd8eb8e4c9dbd98785aaa1e1031'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:38.497607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-62f922c6-54fd-4483-8e33-9a84fdc61a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e872dd8eb8e4c9dbd98785aaa1e1031'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:38.512782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1128/2234] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:38.517351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.518035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1107/2235] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:38 2022] DELETE /identity/v3/users/5e872dd8eb8e4c9dbd98785aaa1e1031 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:38.522354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.522640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.522815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:38.522972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.559852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:38.565153 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:38.569671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb2fa-d3dc-4070-9198-b9a80ca03a04 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.683330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:38.804322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1108/2236] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:38.812318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.815006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:38.836248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:38.837398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.837894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.838366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.839325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.842132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.858229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1129/2237] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:38.859438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:38.881913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eca7a-b524-4673-8524-7a74b399922d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.889085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5903b7-d33a-4303-a687-da3788033147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:38.890151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5903b7-d33a-4303-a687-da3788033147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.890520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5903b7-d33a-4303-a687-da3788033147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.890862 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5903b7-d33a-4303-a687-da3788033147 admin admin] PATH_INFO: `/v3/projects/d3e4ffdef05f4b68a868906ce2ee9b58/users/fb02703dc9684964a15921bbca28c241/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:38.925962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5903b7-d33a-4303-a687-da3788033147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e4ffdef05f4b68a868906ce2ee9b58, user_id=fb02703dc9684964a15921bbca28c241, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:38.929815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5903b7-d33a-4303-a687-da3788033147 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:38.948494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15d96e-f55a-4be4-97e7-394b4e451dd1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:38.958223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1130/2238] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:38 2022] PUT /identity/v3/projects/d3e4ffdef05f4b68a868906ce2ee9b58/users/fb02703dc9684964a15921bbca28c241/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:38.970352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ecc28-aa67-4a2a-b733-bfd93dbf02c9 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:38.970732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ecc28-aa67-4a2a-b733-bfd93dbf02c9 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:38.971010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ecc28-aa67-4a2a-b733-bfd93dbf02c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:39.002056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-879ecc28-aa67-4a2a-b733-bfd93dbf02c9 None None] MFA Rules not processed for user `fb02703dc9684964a15921bbca28c241`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:39.003256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-879ecc28-aa67-4a2a-b733-bfd93dbf02c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:39.083724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:39.084214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:39.084214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:39.084687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:39.164946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:39.199098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1131/2239] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:39.203896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ecc28-aa67-4a2a-b733-bfd93dbf02c9 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:39.262764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:39.264889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:39.342827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1109/2240] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:39.393019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ecc28-aa67-4a2a-b733-bfd93dbf02c9 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:39.405478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:39.406121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:39.406402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:39.406675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:39.407313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:39.411162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:39.447785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1132/2241] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:39 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:39.450661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:39.464481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851ef64-19f7-430c-9331-d00b349345ea service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:39.589213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:39.667825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:39.672084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:39.672434 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:39.672728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:39.674910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:39.678646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:39.748224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1110/2242] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:39 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:39.752291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:39.783528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f82a-a427-438e-a2ee-ccd135a3e00f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:39.799645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:39.800145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:39.801140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:39.801650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:39.802503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:39.807073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:39.838222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1133/2243] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:39.841602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:39.857878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e367c0e-0d26-4c58-9793-e53874b6a432 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:39.883684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f02e8-2cc7-4b55-822b-4e3d70e4f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:39.884324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f02e8-2cc7-4b55-822b-4e3d70e4f705 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:39.885461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f02e8-2cc7-4b55-822b-4e3d70e4f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:39.885461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f02e8-2cc7-4b55-822b-4e3d70e4f705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:39.885834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f02e8-2cc7-4b55-822b-4e3d70e4f705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:39.887613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f02e8-2cc7-4b55-822b-4e3d70e4f705 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:39.923415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1111/2244] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:39.927782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:39.943919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602bf9a-2528-46ce-b54f-2c6174a4a51d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:39.955835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:39.957453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:39.957453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:39.957453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] PATH_INFO: `/v3/projects/350ca3389c724cc49f059992afc829f4/users/99d7e12021eb4283b92aa387a68e5b34/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:39.996020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] RBAC: Authorizing `identity:create_grant(project_id=350ca3389c724cc49f059992afc829f4, user_id=99d7e12021eb4283b92aa387a68e5b34, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:39.998804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:40.028794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1134/2245] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:39 2022] PUT /identity/v3/projects/350ca3389c724cc49f059992afc829f4/users/99d7e12021eb4283b92aa387a68e5b34/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:40.040537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e64f62-5898-4967-a1f5-fff7bfeac7df None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:40.040998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e64f62-5898-4967-a1f5-fff7bfeac7df None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:40.041278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e64f62-5898-4967-a1f5-fff7bfeac7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:40.103284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-87e64f62-5898-4967-a1f5-fff7bfeac7df None None] MFA Rules not processed for user `99d7e12021eb4283b92aa387a68e5b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:40.108212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-87e64f62-5898-4967-a1f5-fff7bfeac7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:40.213717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:40.216514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:40.323766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1112/2246] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:40.330474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e64f62-5898-4967-a1f5-fff7bfeac7df None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:40.377657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f959133-d8e0-4a69-a8cf-206d24cd564f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:40.383474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:40.384311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:40.384739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:40.385079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] PATH_INFO: `/v3/projects/1336dc180d0e4d6cbf4158e8db76ac79` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:40.390425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1336dc180d0e4d6cbf4158e8db76ac79)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:40.390934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:40.526126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e64f62-5898-4967-a1f5-fff7bfeac7df None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:40.543030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:40.546587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1336dc180d0e4d6cbf4158e8db76ac79', 'request_id': 'req-64cb2557-0592-437b-a4b3-b3f1461ddcf0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:40.566349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1336dc180d0e4d6cbf4158e8db76ac79', 'request_id': 'req-64cb2557-0592-437b-a4b3-b3f1461ddcf0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:40.584613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1336dc180d0e4d6cbf4158e8db76ac79', 'request_id': 'req-64cb2557-0592-437b-a4b3-b3f1461ddcf0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:40.624394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] The token cache is being invalidate because project 1336dc180d0e4d6cbf4158e8db76ac79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:40.624741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:40.648392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:40.660625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1135/2247] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:40 2022] DELETE /identity/v3/projects/1336dc180d0e4d6cbf4158e8db76ac79 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:40.661766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:40.666177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:40.689127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:40.720625 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:40.721343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:40.721619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:40.721884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:40.722517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:40.729227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:40.847256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2557-0592-437b-a4b3-b3f1461ddcf0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:40.851352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1113/2248] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:40 2022] POST /identity/v3/projects => generated 377 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:40.852536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:40.863290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:40.930086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:40.930832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:40.931423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:40.931688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] PATH_INFO: `/v3/users/9c78f99058c04330baa3bb878a83ea92` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:40.932956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c78f99058c04330baa3bb878a83ea92)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:40.935376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:41.005052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c78f99058c04330baa3bb878a83ea92'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:41.007822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c78f99058c04330baa3bb878a83ea92'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:41.019554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c78f99058c04330baa3bb878a83ea92'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:41.020777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c78f99058c04330baa3bb878a83ea92'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:41.033254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c78f99058c04330baa3bb878a83ea92'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:41.057820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36b8d2-0c48-4b81-8f79-f9506c8b853d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:41.062937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1136/2249] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:40 2022] DELETE /identity/v3/users/9c78f99058c04330baa3bb878a83ea92 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:41.071069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:41.071959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:41.072384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:41.072799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:41.073578 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:41.076866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:41.146034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1114/2250] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:40 2022] POST /identity/v3/users => generated 295 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:41.149936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:41.151963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:41.158125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:41.346540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32efb-f5f4-4520-96b9-3fd35d2617a9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:41.359443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:41.360478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:41.360759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:41.361034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:41.364011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:41.372994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:41.428366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1137/2251] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:41.430013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:41.455299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36833086-d54c-4d19-8913-2b10602ed42f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:41.487362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:41.493716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:41.493922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:41.494200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] PATH_INFO: `/v3/projects/08eac2b481ee4ba78cc1d3d86e03a00f/users/de7a865201ac4a17bcd69fe92d8d097f/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:41.534217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] RBAC: Authorizing `identity:create_grant(project_id=08eac2b481ee4ba78cc1d3d86e03a00f, user_id=de7a865201ac4a17bcd69fe92d8d097f, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:41.536966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:41.572803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1115/2252] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:41 2022] PUT /identity/v3/projects/08eac2b481ee4ba78cc1d3d86e03a00f/users/de7a865201ac4a17bcd69fe92d8d097f/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:41.575373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:41.615321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e265e-7d63-4cfb-b65e-53491d09d6a9 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:41.746670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0276a89-2964-452e-bf59-0eaaf8f7c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:41.747541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0276a89-2964-452e-bf59-0eaaf8f7c036 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:41.747999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0276a89-2964-452e-bf59-0eaaf8f7c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:41.748847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0276a89-2964-452e-bf59-0eaaf8f7c036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:41.749709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0276a89-2964-452e-bf59-0eaaf8f7c036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:41.752089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0276a89-2964-452e-bf59-0eaaf8f7c036 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:41.776688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:41.791186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1138/2253] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:41.796710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255e908-9100-4146-b4a3-ad5cfe01dcea admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:41.802968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:41.803856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:41.804199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:41.804586 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] PATH_INFO: `/v3/projects/08eac2b481ee4ba78cc1d3d86e03a00f/users/de7a865201ac4a17bcd69fe92d8d097f/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:41.806862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=08eac2b481ee4ba78cc1d3d86e03a00f, user_id=de7a865201ac4a17bcd69fe92d8d097f, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:41.810475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:41.866549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1116/2254] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:41 2022] PUT /identity/v3/projects/08eac2b481ee4ba78cc1d3d86e03a00f/users/de7a865201ac4a17bcd69fe92d8d097f/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:41.868986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:41.869370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:41.869742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:41.912195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] MFA Rules not processed for user `de7a865201ac4a17bcd69fe92d8d097f`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:41.913475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:41.963430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:41.964935 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.020281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1139/2255] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:42.034143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:42.037272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.066195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869af07-445f-4b12-a53a-642033b99cbe admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:42.075371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:42.076118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.076404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.076698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] PATH_INFO: `/v3/users/9d10e96926244716887477f788eb2bf5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.078854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d10e96926244716887477f788eb2bf5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:42.079370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:42.081383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:42.128851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:42.135197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cde146-8178-4f2d-8681-cb75ea63a35b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:42.146705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:42.147334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.147775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.149797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.156874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.171799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d10e96926244716887477f788eb2bf5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.201822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d10e96926244716887477f788eb2bf5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.227288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d10e96926244716887477f788eb2bf5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.243509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d10e96926244716887477f788eb2bf5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.244285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3d1daa48-60a8-4d47-8c6e-494d5178d8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d10e96926244716887477f788eb2bf5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.261039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:42.262569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:42.270404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1117/2256] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:41 2022] DELETE /identity/v3/users/9d10e96926244716887477f788eb2bf5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:42.272526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.272988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.273313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.275517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1140/2257] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:42.288732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:42.290692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.303125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:42.306265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.324118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2db7d-51f2-4052-b9f0-88de5cdf7edf service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:42.430498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1118/2258] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:42.448957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:42.451076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.496721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:42.498387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.498952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.499419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] PATH_INFO: `/v3/projects/b6a7322d368e4aa4af0b4fa887462bdf` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.503234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a7322d368e4aa4af0b4fa887462bdf)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:42.505576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:42.570575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c56b2-5349-40e3-a8a9-56645468ddac None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:42.576077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a7322d368e4aa4af0b4fa887462bdf', 'request_id': 'req-fdc89c95-f495-4526-9631-16abc1058e7b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.583517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a7322d368e4aa4af0b4fa887462bdf', 'request_id': 'req-fdc89c95-f495-4526-9631-16abc1058e7b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.592454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a7322d368e4aa4af0b4fa887462bdf', 'request_id': 'req-fdc89c95-f495-4526-9631-16abc1058e7b'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.613386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] The token cache is being invalidate because project b6a7322d368e4aa4af0b4fa887462bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:42.614919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.615952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-fdc89c95-f495-4526-9631-16abc1058e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:42.618193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1141/2259] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:42 2022] DELETE /identity/v3/projects/b6a7322d368e4aa4af0b4fa887462bdf => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:42.623002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700288c-6d2c-4bc9-b8db-526d8391ae23 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.623966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700288c-6d2c-4bc9-b8db-526d8391ae23 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.624429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700288c-6d2c-4bc9-b8db-526d8391ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.637358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:42.637734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:42.639792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.640695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.641375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.648268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.655928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5700288c-6d2c-4bc9-b8db-526d8391ae23 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:42.657524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5700288c-6d2c-4bc9-b8db-526d8391ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.675633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:42.765977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:42.769882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:42.795899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1142/2260] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:42.798075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1119/2261] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:42.803628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fbe7a-c17f-49dd-9d8f-466b1e212b80 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.803917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fbe7a-c17f-49dd-9d8f-466b1e212b80 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.804226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fbe7a-c17f-49dd-9d8f-466b1e212b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.851531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b53fbe7a-c17f-49dd-9d8f-466b1e212b80 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:42.856535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b53fbe7a-c17f-49dd-9d8f-466b1e212b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:42.882652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1143/2262] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:42.884188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:42.898296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d24d-ee2d-4ca6-aec2-100cc1b9e92d service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:42.908128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:42.911869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.912219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.912577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.913304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:42.913614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:42.915282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:42.947706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1120/2263] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:42.948769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fbe7a-c17f-49dd-9d8f-466b1e212b80 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:42.973777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fbe7a-c17f-49dd-9d8f-466b1e212b80 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:42.980834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:42.981558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:42.982149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:42.982423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:42.983288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:42.985257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:43.019292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1144/2264] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:42 2022] POST /identity/v3/projects => generated 361 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:43.024016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:43.035866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575e74d-b17f-4369-baa2-fc7fb8a6850d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:43.135289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:43.135998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.136307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.137658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.137658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:43.140973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:43.168707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1121/2265] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:43 2022] POST /identity/v3/users => generated 281 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:43.172919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:43.186552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d09e-7b2b-4f1d-8ba6-8872319567e4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:43.191599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:43.192274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.193126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.193126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.193615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:43.195376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:43.207525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1145/2266] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:43.211454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:43.221863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f08f3-62a3-4f0e-bc19-51425e3ecfa0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:43.227719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7dcda-bf1b-4662-9fd4-81304f6058c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:43.228340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dcda-bf1b-4662-9fd4-81304f6058c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.228604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dcda-bf1b-4662-9fd4-81304f6058c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.228895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7dcda-bf1b-4662-9fd4-81304f6058c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.229545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7dcda-bf1b-4662-9fd4-81304f6058c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:43.231229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7dcda-bf1b-4662-9fd4-81304f6058c1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:43.261460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1122/2267] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:43.262529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:43.273926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822edce-c329-4ab7-ba13-643f9de54b60 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:43.280376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:43.281151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.281507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.281856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] PATH_INFO: `/v3/projects/659e37e0c8614b6baffeaa5db8a39604/users/ff3a4105d0334b3b93c2cdd81dd44715/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.313705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659e37e0c8614b6baffeaa5db8a39604, user_id=ff3a4105d0334b3b93c2cdd81dd44715, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:43.320143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:43.337281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1146/2268] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:43 2022] PUT /identity/v3/projects/659e37e0c8614b6baffeaa5db8a39604/users/ff3a4105d0334b3b93c2cdd81dd44715/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:43.347830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c08f6-1f70-4296-b956-eae21681a064 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.348122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c08f6-1f70-4296-b956-eae21681a064 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.348399 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c08f6-1f70-4296-b956-eae21681a064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.390274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-154c08f6-1f70-4296-b956-eae21681a064 None None] MFA Rules not processed for user `ff3a4105d0334b3b93c2cdd81dd44715`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:43.391832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-154c08f6-1f70-4296-b956-eae21681a064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:43.469496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1123/2269] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:43.512657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:43.515442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:43.601326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592ce5a-f99b-4475-bd6f-2cce888e7af6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:43.605580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:43.607357 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.608207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.608207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.620265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:43.622291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:43.634253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1147/2270] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:43.654453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c08f6-1f70-4296-b956-eae21681a064 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:43.665010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:43.760311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c08f6-1f70-4296-b956-eae21681a064 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:43.769585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:43.771387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.771980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.774407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] PATH_INFO: `/v3/users/ff3a4105d0334b3b93c2cdd81dd44715` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.776481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3a4105d0334b3b93c2cdd81dd44715)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:43.779916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:43.864049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3a4105d0334b3b93c2cdd81dd44715'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:43.891013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3a4105d0334b3b93c2cdd81dd44715'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:43.907785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3a4105d0334b3b93c2cdd81dd44715'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:43.912799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:43.914354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:43.921579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3a4105d0334b3b93c2cdd81dd44715'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:43.922486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-7b0af7a0-d72c-4428-92d6-931ea0e07392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3a4105d0334b3b93c2cdd81dd44715'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:43.931565 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1124/2271] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:43 2022] DELETE /identity/v3/users/ff3a4105d0334b3b93c2cdd81dd44715 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:43.939683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:43.940320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:43.940821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:43.942474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0163-69eb-4492-883f-c37b9244637c service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:43.970576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:43.973136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:44.023322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:44.063522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:44.064270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.064545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.064825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] PATH_INFO: `/v3/projects/9d2ed7cf4de94a84a323b20315eeb429` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.075805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2ed7cf4de94a84a323b20315eeb429)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:44.075805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:44.096245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1125/2272] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:44.153377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:44.155604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:44.215666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2ed7cf4de94a84a323b20315eeb429', 'request_id': 'req-036f797f-21af-408f-8112-ecbe58e6cb07'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:44.239988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2ed7cf4de94a84a323b20315eeb429', 'request_id': 'req-036f797f-21af-408f-8112-ecbe58e6cb07'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:44.240668 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:44.265353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2ed7cf4de94a84a323b20315eeb429', 'request_id': 'req-036f797f-21af-408f-8112-ecbe58e6cb07'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:44.286838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] The token cache is being invalidate because project 9d2ed7cf4de94a84a323b20315eeb429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:44.287135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:44.288402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-036f797f-21af-408f-8112-ecbe58e6cb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:44.290857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1148/2273] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:43 2022] DELETE /identity/v3/projects/9d2ed7cf4de94a84a323b20315eeb429 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:44.297022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.297319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.297602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.309480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374b475-cc84-45e4-a249-5ba7ee3cbf34 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:44.348258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:44.356107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:44.433579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb811ec-3a05-4dde-a4ba-2b1e9005c3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:44.434784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb811ec-3a05-4dde-a4ba-2b1e9005c3dd service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.436226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb811ec-3a05-4dde-a4ba-2b1e9005c3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.439358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb811ec-3a05-4dde-a4ba-2b1e9005c3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.443507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5fb811ec-3a05-4dde-a4ba-2b1e9005c3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:44.468376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1149/2274] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:44.470487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:44.472214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:44.571936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb811ec-3a05-4dde-a4ba-2b1e9005c3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:44.573522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb811ec-3a05-4dde-a4ba-2b1e9005c3dd service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:44.575531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd47233-9b07-4aa5-8c3e-87bc844d1a95 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:44.581686 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:44.582566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.583900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.584425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.587280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:44.589254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1126/2275] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:44.597090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8170fef-0528-4c24-b456-656d00085042 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.597381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8170fef-0528-4c24-b456-656d00085042 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.597664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8170fef-0528-4c24-b456-656d00085042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.626560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-d8170fef-0528-4c24-b456-656d00085042 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:44.630318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-d8170fef-0528-4c24-b456-656d00085042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:44.633175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:44.650314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1127/2276] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:44.654339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8170fef-0528-4c24-b456-656d00085042 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:44.668431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8170fef-0528-4c24-b456-656d00085042 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:44.685236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:44.687960 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.688354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.688654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.689488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:44.690819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:44.694877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:44.705194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:44.707136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:44.719270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1150/2277] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:44.724147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1128/2278] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:44.728295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:44.742302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd7f87-a87e-4a73-8324-b586b65087a3 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:44.751110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:44.752390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.753167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.753646 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.754534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:44.758269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:44.808081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1151/2279] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:44 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:44.811560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:44.827177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7071-658a-4fed-91cd-004bbd86d19b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:44.961654 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:44.962463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:44.962809 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:44.963604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:44.965216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:44.972928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:45.030144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1129/2280] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:44 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:45.034753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:45.046905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02464f-25c2-4fde-a55e-a3641d50e6ac admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:45.056827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:45.056827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.058510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.058510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.058510 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:45.060653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:45.088615 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1152/2281] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:45.092848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:45.099842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:45.108183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c6719-384e-4328-aa3c-c4d96c498a1f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:45.115868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d14c-d98f-4810-9387-bd09717d7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:45.116735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d14c-d98f-4810-9387-bd09717d7de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.117325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d14c-d98f-4810-9387-bd09717d7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.117717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d14c-d98f-4810-9387-bd09717d7de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.118546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d14c-d98f-4810-9387-bd09717d7de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:45.121541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d14c-d98f-4810-9387-bd09717d7de0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:45.141695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1130/2282] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:45.146280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:45.170483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0114dbb-cbbc-4ff3-af86-473ce04765d5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:45.176954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:45.177817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.177817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.177817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] PATH_INFO: `/v3/projects/6fc324401ca54549a1229602cc3d058d/users/383d3c8406d144338a82c0d2f69ad4ed/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.211290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc324401ca54549a1229602cc3d058d, user_id=383d3c8406d144338a82c0d2f69ad4ed, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:45.214896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:45.245150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1153/2283] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:45 2022] PUT /identity/v3/projects/6fc324401ca54549a1229602cc3d058d/users/383d3c8406d144338a82c0d2f69ad4ed/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:45.248646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.249689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.250597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.314579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] MFA Rules not processed for user `383d3c8406d144338a82c0d2f69ad4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:45.317633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:45.443912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1131/2284] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:45.457624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:45.537155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c33876-7723-429b-a23f-5d9959466bcd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:45.551606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:45.551606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.551606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.551606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.587828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:45.588428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:45.596820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:45.598982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:45.614868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cfcc7-de88-487e-adb6-bf17326a7e70 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:45.617175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1154/2285] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:45.618833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:45.620733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596053d0-0ba5-4a4b-a259-dd7dfea1e498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:45.621775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596053d0-0ba5-4a4b-a259-dd7dfea1e498 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.622255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596053d0-0ba5-4a4b-a259-dd7dfea1e498 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.622737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596053d0-0ba5-4a4b-a259-dd7dfea1e498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.622841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:45.625669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-596053d0-0ba5-4a4b-a259-dd7dfea1e498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:45.774100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596053d0-0ba5-4a4b-a259-dd7dfea1e498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:45.775764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596053d0-0ba5-4a4b-a259-dd7dfea1e498 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:45.786720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf46794-5db5-4db1-a9bc-5be3c704b687 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:45.791675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:45.791832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1132/2286] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:45.792516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.792895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.793630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] PATH_INFO: `/v3/projects/659e37e0c8614b6baffeaa5db8a39604` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.795390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659e37e0c8614b6baffeaa5db8a39604)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:45.797612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:45.821565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:45.873043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659e37e0c8614b6baffeaa5db8a39604', 'request_id': 'req-1b135766-140d-4ee2-875f-5cf3946b2fb4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:45.880143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659e37e0c8614b6baffeaa5db8a39604', 'request_id': 'req-1b135766-140d-4ee2-875f-5cf3946b2fb4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:45.892516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659e37e0c8614b6baffeaa5db8a39604', 'request_id': 'req-1b135766-140d-4ee2-875f-5cf3946b2fb4'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:45.912925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] The token cache is being invalidate because project 659e37e0c8614b6baffeaa5db8a39604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:45.913385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:45.914284 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1b135766-140d-4ee2-875f-5cf3946b2fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:45.917008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1155/2287] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:45 2022] DELETE /identity/v3/projects/659e37e0c8614b6baffeaa5db8a39604 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:45.925059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf6f01-7439-4f33-9d7b-edae7158b981 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:45.925334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf6f01-7439-4f33-9d7b-edae7158b981 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:45.925577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf6f01-7439-4f33-9d7b-edae7158b981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:45.967414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-33bf6f01-7439-4f33-9d7b-edae7158b981 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:45.969125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-33bf6f01-7439-4f33-9d7b-edae7158b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:46.082207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1133/2288] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:46.092146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcedc-25e8-4ad4-8fe4-51cdfee1bafd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.093105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcedc-25e8-4ad4-8fe4-51cdfee1bafd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.093389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcedc-25e8-4ad4-8fe4-51cdfee1bafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.140991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0dcdcedc-25e8-4ad4-8fe4-51cdfee1bafd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:46.142226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0dcdcedc-25e8-4ad4-8fe4-51cdfee1bafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:46.166380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1156/2289] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:46.166746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf6f01-7439-4f33-9d7b-edae7158b981 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:46.177824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf6f01-7439-4f33-9d7b-edae7158b981 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:46.195944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:46.196649 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.197189 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.197469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.198384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:46.198611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:46.200553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:46.232292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1134/2290] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:46.234662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdcedc-25e8-4ad4-8fe4-51cdfee1bafd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:46.254903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdcedc-25e8-4ad4-8fe4-51cdfee1bafd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:46.265928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:46.266580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.266969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.267264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.267937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:46.270028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:46.329556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1157/2291] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:46 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:46.333901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:46.339542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:46.356585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fb5bd-c084-458f-8713-555fe3403d4b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:46.457831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:46.458473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.458932 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.459155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.459918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:46.462780 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:46.508827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1135/2292] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:46 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:46.513401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:46.530443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318624d-49ca-4aa2-9d12-701fc82fd56c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:46.544667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:46.545424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.545805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.546177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.546940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:46.550994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:46.572008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1158/2293] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:46.577000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:46.589479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceebd0-7c57-4ec7-a281-0b136e01c739 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:46.598275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e4026-09e7-47be-bdfe-7c83a2da7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:46.599123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4026-09e7-47be-bdfe-7c83a2da7cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.599395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4026-09e7-47be-bdfe-7c83a2da7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.599714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e4026-09e7-47be-bdfe-7c83a2da7cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.600623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e4026-09e7-47be-bdfe-7c83a2da7cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:46.603019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e4026-09e7-47be-bdfe-7c83a2da7cb1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:46.635990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1136/2294] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:46.636520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:46.650180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb17d5a-948b-4ad4-907d-6ab17c0575e3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:46.656457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:46.657565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.658149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.658749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] PATH_INFO: `/v3/projects/711f041e47a940348ebe9a9dcd5b92dd/users/82cce9c8d04a491da6aa13437937eaef/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.682684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=711f041e47a940348ebe9a9dcd5b92dd, user_id=82cce9c8d04a491da6aa13437937eaef, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:46.686692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:46.714295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1159/2295] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:46 2022] PUT /identity/v3/projects/711f041e47a940348ebe9a9dcd5b92dd/users/82cce9c8d04a491da6aa13437937eaef/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:46.726246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:46.726638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:46.727012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:46.801260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] MFA Rules not processed for user `82cce9c8d04a491da6aa13437937eaef`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:46.802752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:46.906023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1137/2296] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:46.918788 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:46.921519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:47.001156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed965-aaed-4e39-a84a-e534187963ec admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:47.006571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:47.007986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:47.008349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:47.009275 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:47.019772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:47.021298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:47.056572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1160/2297] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:49.255277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:49.257167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:49.346715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:49.348346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:49.441803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:49.494041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65962d-9e6a-44fc-afdb-11b95b79353a service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:49.503390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:49.504548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:49.508829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:49.508829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] PATH_INFO: `/v3/users/383d3c8406d144338a82c0d2f69ad4ed` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:49.511606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=383d3c8406d144338a82c0d2f69ad4ed)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:49.526327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:49.623894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383d3c8406d144338a82c0d2f69ad4ed'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.624698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383d3c8406d144338a82c0d2f69ad4ed'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.656695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383d3c8406d144338a82c0d2f69ad4ed'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.657688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383d3c8406d144338a82c0d2f69ad4ed'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.667511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aff242-06b5-417c-8b17-abf09977d810 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:49.672087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-68a5f125-b49d-4f6b-92fb-722ff3463d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383d3c8406d144338a82c0d2f69ad4ed'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.673125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:49.673917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:49.674275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:49.674890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] PATH_INFO: `/v3/users/fb02703dc9684964a15921bbca28c241` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:49.676266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb02703dc9684964a15921bbca28c241)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:49.678623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:49.702107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1161/2298] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:49 2022] DELETE /identity/v3/users/383d3c8406d144338a82c0d2f69ad4ed => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:49.702523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:49.706719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:49.707289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:49.707483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:49.731633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:49.732954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:49.766887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb02703dc9684964a15921bbca28c241'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.778910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb02703dc9684964a15921bbca28c241'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.794359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb02703dc9684964a15921bbca28c241'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.809915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb02703dc9684964a15921bbca28c241'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.811055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff28181d-3b15-4905-8eb8-93fe29150418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb02703dc9684964a15921bbca28c241'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:49.818257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1138/2299] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:49 2022] DELETE /identity/v3/users/fb02703dc9684964a15921bbca28c241 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:49.821254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1162/2300] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:49.822641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:49.822930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:49.823322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:49.833078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:49.834757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:49.845157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:49.846653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:49.902052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea373e1-0b00-4247-828c-ad760d2bbba0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:49.921796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1139/2301] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:49.923296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:49.931977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:49.933477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:49.960215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:49.960855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:49.961130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:49.961549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:49.970853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:49.972373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:49.982032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1163/2302] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:40:49.991824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f7d6e-7545-4f02-a5de-aa3da9b48e81 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:49.994590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:49.995282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:49.995554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:49.995874 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:50.007186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:50.010506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:50.030546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1140/2303] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:50.539375 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:50.543377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:50.589194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84103053-b7c4-4e3d-8ebc-5f4bad7a389b service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:50.611241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:50.614159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:50.614595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:50.615376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] PATH_INFO: `/v3/projects/6fc324401ca54549a1229602cc3d058d` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:50.616043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:50.617684 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:50.620688 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc324401ca54549a1229602cc3d058d)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:50.629709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:50.643886 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ea1df-12c9-4f2a-8581-20f3231f871b service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:50.656451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:50.657894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:50.658456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:50.658898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] PATH_INFO: `/v3/projects/d3e4ffdef05f4b68a868906ce2ee9b58` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:50.661228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e4ffdef05f4b68a868906ce2ee9b58)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:50.664004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:50.730486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:50.767483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e4ffdef05f4b68a868906ce2ee9b58', 'request_id': 'req-833a6124-bea2-4bce-bcd6-74005d459154'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.780893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e4ffdef05f4b68a868906ce2ee9b58', 'request_id': 'req-833a6124-bea2-4bce-bcd6-74005d459154'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.782054 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc324401ca54549a1229602cc3d058d', 'request_id': 'req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.793160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc324401ca54549a1229602cc3d058d', 'request_id': 'req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.797978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e4ffdef05f4b68a868906ce2ee9b58', 'request_id': 'req-833a6124-bea2-4bce-bcd6-74005d459154'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.810903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc324401ca54549a1229602cc3d058d', 'request_id': 'req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.815975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] The token cache is being invalidate because project d3e4ffdef05f4b68a868906ce2ee9b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:50.816271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.817831 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.819556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1141/2304] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:50 2022] DELETE /identity/v3/projects/d3e4ffdef05f4b68a868906ce2ee9b58 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:50.823705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:50.825534 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:50.839057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] The token cache is being invalidate because project 6fc324401ca54549a1229602cc3d058d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:50.839406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.840465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9d4aee9f-63b7-4deb-a1ff-6b00decc98a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:50.844300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1164/2305] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:50 2022] DELETE /identity/v3/projects/6fc324401ca54549a1229602cc3d058d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:50.849311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874879a-2f60-42bb-bf97-d47604318121 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:50.849611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874879a-2f60-42bb-bf97-d47604318121 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:50.849887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874879a-2f60-42bb-bf97-d47604318121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:50.886664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3874879a-2f60-42bb-bf97-d47604318121 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:50.888281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3874879a-2f60-42bb-bf97-d47604318121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:50.954293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6124-bea2-4bce-bcd6-74005d459154 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:50.965791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:50.966536 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:50.967098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:50.968178 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] PATH_INFO: `/v3/users/99d7e12021eb4283b92aa387a68e5b34` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:50.970609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d7e12021eb4283b92aa387a68e5b34)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:50.975786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.010024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1165/2306] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:51.011678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf082b-631d-4d10-937e-1dcd52eb47be None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.012066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf082b-631d-4d10-937e-1dcd52eb47be None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.012442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf082b-631d-4d10-937e-1dcd52eb47be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.040297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8bbf082b-631d-4d10-937e-1dcd52eb47be None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:51.042237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8bbf082b-631d-4d10-937e-1dcd52eb47be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:51.063329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1166/2307] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:51.064451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf082b-631d-4d10-937e-1dcd52eb47be None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.080403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf082b-631d-4d10-937e-1dcd52eb47be None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.087175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d7e12021eb4283b92aa387a68e5b34'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.089944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.092227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.094764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.094764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.097220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:51.097220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.098655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.102687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d7e12021eb4283b92aa387a68e5b34'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.123595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1167/2308] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:51.129227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.132752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d7e12021eb4283b92aa387a68e5b34'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.147109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d7e12021eb4283b92aa387a68e5b34'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.148406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d7e12021eb4283b92aa387a68e5b34'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.152547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c705c-1868-4141-a78e-1ee7cb46b9ac admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.157619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.158335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.158774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1142/2309] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:50 2022] DELETE /identity/v3/users/99d7e12021eb4283b92aa387a68e5b34 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:51.158895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.159128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.159921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.162665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.200301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1168/2310] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:51 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:51.201248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.203343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:51.262400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:51.334612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64a3d-b083-4809-a979-58f1fdd487f9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.405921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011e053-085f-4904-8070-256903522e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.406605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011e053-085f-4904-8070-256903522e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.406899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011e053-085f-4904-8070-256903522e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.407170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011e053-085f-4904-8070-256903522e59 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.407946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011e053-085f-4904-8070-256903522e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.410043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011e053-085f-4904-8070-256903522e59 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.438202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1143/2311] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:51 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:51.440224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.448766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:51.457552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496f45-5e83-44d7-b3e6-9b178da7c861 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.464347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.465320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.466177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.466557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.467317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.469240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.481738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1169/2312] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:51.489424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011e053-085f-4904-8070-256903522e59 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.490603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.491387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7011e053-085f-4904-8070-256903522e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:51.505907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011e053-085f-4904-8070-256903522e59 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.510996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.511653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.512012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.512414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] PATH_INFO: `/v3/projects/350ca3389c724cc49f059992afc829f4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.513799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=350ca3389c724cc49f059992afc829f4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.513923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab101be-c4c6-42ab-9019-71528a689f66 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.516208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.519891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.520566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.520888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.521290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.522699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.525990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.554675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1170/2313] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:51.555778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.565636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffc8dd-24a1-4f5e-a5fc-5f124c0b2c52 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.577214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350ca3389c724cc49f059992afc829f4', 'request_id': 'req-c98149ad-74a3-47ee-8c3b-aa7898abb59b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.593662 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350ca3389c724cc49f059992afc829f4', 'request_id': 'req-c98149ad-74a3-47ee-8c3b-aa7898abb59b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.602200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350ca3389c724cc49f059992afc829f4', 'request_id': 'req-c98149ad-74a3-47ee-8c3b-aa7898abb59b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.616573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] The token cache is being invalidate because project 350ca3389c724cc49f059992afc829f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:51.618492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.620288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.623456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1144/2314] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:51 2022] DELETE /identity/v3/projects/350ca3389c724cc49f059992afc829f4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:51.627969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.630440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:51.634726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bd1a2-c0aa-48a0-9e09-35ff4b6ecd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.635569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd1a2-c0aa-48a0-9e09-35ff4b6ecd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.635988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd1a2-c0aa-48a0-9e09-35ff4b6ecd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.636369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd1a2-c0aa-48a0-9e09-35ff4b6ecd7e admin admin] PATH_INFO: `/v3/projects/4e02e98d2a89486c899987d052980ed2/users/be57c2b0f9a844ea9567e15930b41353/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.645156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98149ad-74a3-47ee-8c3b-aa7898abb59b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.650327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.650963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.651263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.651496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] PATH_INFO: `/v3/users/de7a865201ac4a17bcd69fe92d8d097f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.652751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7a865201ac4a17bcd69fe92d8d097f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.654898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.658851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bd1a2-c0aa-48a0-9e09-35ff4b6ecd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e02e98d2a89486c899987d052980ed2, user_id=be57c2b0f9a844ea9567e15930b41353, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:51.662812 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bd1a2-c0aa-48a0-9e09-35ff4b6ecd7e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:51.685943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1171/2315] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:51 2022] PUT /identity/v3/projects/4e02e98d2a89486c899987d052980ed2/users/be57c2b0f9a844ea9567e15930b41353/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:51.697908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.698551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.699953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:51.731531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] MFA Rules not processed for user `be57c2b0f9a844ea9567e15930b41353`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:51.732990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:51.737192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7a865201ac4a17bcd69fe92d8d097f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.740968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:51.752173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7a865201ac4a17bcd69fe92d8d097f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.791996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7a865201ac4a17bcd69fe92d8d097f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.813984 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7a865201ac4a17bcd69fe92d8d097f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.814849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7a865201ac4a17bcd69fe92d8d097f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:51.828510 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1145/2316] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:51 2022] DELETE /identity/v3/users/de7a865201ac4a17bcd69fe92d8d097f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:51.846068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1172/2317] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:51.894645 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:51.896212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:51.967069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b3299-45ce-4374-a194-8f7e15f333c9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:51.972341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb723044-1cca-4e48-972d-9fc4d5cec789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:51.973022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723044-1cca-4e48-972d-9fc4d5cec789 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:51.973361 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723044-1cca-4e48-972d-9fc4d5cec789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:51.974252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723044-1cca-4e48-972d-9fc4d5cec789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:52.049031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb723044-1cca-4e48-972d-9fc4d5cec789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:52.050470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb723044-1cca-4e48-972d-9fc4d5cec789 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:52.060688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1146/2318] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:52.156571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:52.158334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:52.239377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:52.247598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffefdb-72ed-4d8a-be59-72549c28bbbd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:52.325711 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:52.326323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:52.326641 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:52.326912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] PATH_INFO: `/v3/projects/08eac2b481ee4ba78cc1d3d86e03a00f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:52.328593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=08eac2b481ee4ba78cc1d3d86e03a00f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:52.330911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:52.448625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08eac2b481ee4ba78cc1d3d86e03a00f', 'request_id': 'req-b97c38ad-56ce-4950-9f0f-773e823277ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:52.458462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08eac2b481ee4ba78cc1d3d86e03a00f', 'request_id': 'req-b97c38ad-56ce-4950-9f0f-773e823277ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:52.480668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08eac2b481ee4ba78cc1d3d86e03a00f', 'request_id': 'req-b97c38ad-56ce-4950-9f0f-773e823277ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:52.515941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] The token cache is being invalidate because project 08eac2b481ee4ba78cc1d3d86e03a00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:52.516245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:52.516943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b97c38ad-56ce-4950-9f0f-773e823277ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:52.518777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1173/2319] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:52 2022] DELETE /identity/v3/projects/08eac2b481ee4ba78cc1d3d86e03a00f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:52.523921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4f8fa-1145-453d-9d32-147732117b44 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:52.524352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4f8fa-1145-453d-9d32-147732117b44 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:52.524636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4f8fa-1145-453d-9d32-147732117b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:52.556035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-09e4f8fa-1145-453d-9d32-147732117b44 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:52.558090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-09e4f8fa-1145-453d-9d32-147732117b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:52.653392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1147/2320] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:52.660608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b3e8-3d99-4253-8803-82fa9d600bfd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:52.661114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b3e8-3d99-4253-8803-82fa9d600bfd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:52.661114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230b3e8-3d99-4253-8803-82fa9d600bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:52.682354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f230b3e8-3d99-4253-8803-82fa9d600bfd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:52.683611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f230b3e8-3d99-4253-8803-82fa9d600bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:52.693706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1174/2321] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:52.698162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4f8fa-1145-453d-9d32-147732117b44 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:52.708515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4f8fa-1145-453d-9d32-147732117b44 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:52.720612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:52.720952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:52.721283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:52.721589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:52.722254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:52.722574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:52.724643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:52.757841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1148/2322] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:52.764106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b3e8-3d99-4253-8803-82fa9d600bfd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:52.795973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230b3e8-3d99-4253-8803-82fa9d600bfd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:52.810505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:52.811179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:52.811503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:52.811739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:52.812439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:52.814427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:52.889990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1175/2323] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:52 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:52.890177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:52.902367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a01e41-f938-48c8-8b53-d3ca6dafa91d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:52.916508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:53.035765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:53.037374 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:53.037770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:53.038140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:53.039023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:53.042049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:53.086254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1149/2324] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:52 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:40:53.090299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:53.106314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6123232-cf23-4bdc-b818-7dec435e4c0f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:53.115220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:53.116039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:53.116371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:53.116880 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:53.118141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:53.120835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:53.152748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1176/2325] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:40:53.157746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:53.171354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38a0dd-f128-4df0-95cc-f85e4325ebec admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:53.177094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423bbfc-8ce6-47b5-a034-20eb6a0cc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:53.177712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bbfc-8ce6-47b5-a034-20eb6a0cc944 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:53.177992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bbfc-8ce6-47b5-a034-20eb6a0cc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:53.178266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bbfc-8ce6-47b5-a034-20eb6a0cc944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:53.178917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423bbfc-8ce6-47b5-a034-20eb6a0cc944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:53.180565 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423bbfc-8ce6-47b5-a034-20eb6a0cc944 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:53.197525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1150/2326] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:40:53.202178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:53.220661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b94e48-90fb-4508-9317-a34950b2888a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:53.233079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:53.234565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:53.235419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:53.236392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] PATH_INFO: `/v3/projects/dab8f88753534f25b68446b86adb5f46/users/eb463c9680d64e53affb1ab8d4e7a6f6/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:53.270531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab8f88753534f25b68446b86adb5f46, user_id=eb463c9680d64e53affb1ab8d4e7a6f6, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:53.273652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:53.303849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1177/2327] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:40:53 2022] PUT /identity/v3/projects/dab8f88753534f25b68446b86adb5f46/users/eb463c9680d64e53affb1ab8d4e7a6f6/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:40:53.311531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7c81-b948-44d4-aea1-e1cafafc52af None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:53.311951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7c81-b948-44d4-aea1-e1cafafc52af None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:53.312119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e7c81-b948-44d4-aea1-e1cafafc52af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:53.351292 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-528e7c81-b948-44d4-aea1-e1cafafc52af None None] MFA Rules not processed for user `eb463c9680d64e53affb1ab8d4e7a6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:53.353436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-528e7c81-b948-44d4-aea1-e1cafafc52af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:53.452367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1151/2328] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:53.465326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:53.467715 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:53.555060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:53.621824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de4b9-5f6f-4f18-b5ef-e75eebaf55b4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:53.637901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a331472a0040d68824a2245bf3e716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:53.639139 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:53.639807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:53.640379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:53.657400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:53.659534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:53.673202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1178/2329] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:54.920614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:54.921435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:54.921881 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:54.970210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] MFA Rules not processed for user `a2c490a6ee594cb3826332dfa8eeb45a`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:54.973597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:55.084129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1152/2330] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:57.042765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:57.044586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:57.114985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47158069-8c20-47d5-a131-e0f96139ffba service glance] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:57.118602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b448dd2-cfb8-45e1-8e4f-5192a7dd413c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:57.119233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448dd2-cfb8-45e1-8e4f-5192a7dd413c service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:57.119512 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448dd2-cfb8-45e1-8e4f-5192a7dd413c service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:57.119825 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448dd2-cfb8-45e1-8e4f-5192a7dd413c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:57.121631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9b448dd2-cfb8-45e1-8e4f-5192a7dd413c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:57.202937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b448dd2-cfb8-45e1-8e4f-5192a7dd413c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:57.204419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b448dd2-cfb8-45e1-8e4f-5192a7dd413c service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:57.214224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1179/2331] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:58.745587 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:58.747882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:58.775492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:58.820233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bb593-061d-44de-a869-302cf561f820 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:58.831170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:58.831860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:58.832235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:58.832500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] PATH_INFO: `/v3/users/82cce9c8d04a491da6aa13437937eaef` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:58.833682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cce9c8d04a491da6aa13437937eaef)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:58.835663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:58.883035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cce9c8d04a491da6aa13437937eaef'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:58.890785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cce9c8d04a491da6aa13437937eaef'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:58.904134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cce9c8d04a491da6aa13437937eaef'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:58.914224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cce9c8d04a491da6aa13437937eaef'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:58.914952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cce9c8d04a491da6aa13437937eaef'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:58.922522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1153/2332] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:40:58 2022] DELETE /identity/v3/users/82cce9c8d04a491da6aa13437937eaef => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:58.927254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:58.927798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:58.927798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:58.948021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:58.949237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:59.017167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1180/2333] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:40:59.027288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:59.028893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:59.089726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea17144-3ef3-4d59-b154-5e986f7e3ada admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:59.093971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e5f96-4042-45fd-a04e-03c1eb082152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:59.094734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5f96-4042-45fd-a04e-03c1eb082152 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.095014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5f96-4042-45fd-a04e-03c1eb082152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.095286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5f96-4042-45fd-a04e-03c1eb082152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.105138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e5f96-4042-45fd-a04e-03c1eb082152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:59.106632 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e5f96-4042-45fd-a04e-03c1eb082152 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:59.116437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1154/2334] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:40:59.409530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:59.410949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:59.431670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca12fb-cf73-4b9a-8b65-a64427766347 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:59.438139 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:59.439078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.439467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.444596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] PATH_INFO: `/v3/projects/711f041e47a940348ebe9a9dcd5b92dd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.446153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=711f041e47a940348ebe9a9dcd5b92dd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:59.448293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:59.471629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:59.502804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711f041e47a940348ebe9a9dcd5b92dd', 'request_id': 'req-421f0739-4501-4db6-ba64-21fc396b41ea'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:59.509142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711f041e47a940348ebe9a9dcd5b92dd', 'request_id': 'req-421f0739-4501-4db6-ba64-21fc396b41ea'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:59.516622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711f041e47a940348ebe9a9dcd5b92dd', 'request_id': 'req-421f0739-4501-4db6-ba64-21fc396b41ea'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:59.540045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] The token cache is being invalidate because project 711f041e47a940348ebe9a9dcd5b92dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:40:59.540391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:59.541068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-421f0739-4501-4db6-ba64-21fc396b41ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:40:59.542926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1181/2335] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:40:59 2022] DELETE /identity/v3/projects/711f041e47a940348ebe9a9dcd5b92dd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:40:59.549528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074fa46-c100-4e3c-a8d8-757fdd234bfc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.550080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074fa46-c100-4e3c-a8d8-757fdd234bfc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.550744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074fa46-c100-4e3c-a8d8-757fdd234bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.574799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e074fa46-c100-4e3c-a8d8-757fdd234bfc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:59.576748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e074fa46-c100-4e3c-a8d8-757fdd234bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:59.647291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:40:59.675201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1155/2336] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:59.684683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d371-3b95-47ca-9d41-eb876ef9ff90 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.685289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d371-3b95-47ca-9d41-eb876ef9ff90 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.685736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d371-3b95-47ca-9d41-eb876ef9ff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.711305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d827d371-3b95-47ca-9d41-eb876ef9ff90 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:40:59.714657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d827d371-3b95-47ca-9d41-eb876ef9ff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:40:59.728337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1182/2337] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:40:59.729634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074fa46-c100-4e3c-a8d8-757fdd234bfc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:59.742674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074fa46-c100-4e3c-a8d8-757fdd234bfc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:59.749579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:59.750207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.750499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.750747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.751525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:40:59.751777 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:59.753504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:59.785670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1156/2338] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:40:59.791203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d371-3b95-47ca-9d41-eb876ef9ff90 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:59.801923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d371-3b95-47ca-9d41-eb876ef9ff90 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:59.807059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:59.807662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.807994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.808336 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.808957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:59.811312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:59.865487 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1183/2339] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:40:59 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:59.867394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:59.878772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748dcc2-b9c1-4598-992f-c3048f8f47e7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:59.945560 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:59.946168 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.946446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.946718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.947356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:59.949287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:40:59.970770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1157/2340] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:40:59 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:40:59.975382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:40:59.986727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61ee50-b227-41b2-8d0e-fed807c16e6c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:40:59.992676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:40:59.993317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:40:59.993599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:40:59.993877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:40:59.994522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:40:59.996172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:00.007266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1184/2341] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:00.011472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:00.022702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520bfb9-90cf-4668-b209-ebc1b39d554e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:00.028675 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3bb35-f116-428f-a2fb-28c64909ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:00.028992 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3bb35-f116-428f-a2fb-28c64909ee1d admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:00.029297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3bb35-f116-428f-a2fb-28c64909ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:00.029567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3bb35-f116-428f-a2fb-28c64909ee1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:00.030225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3bb35-f116-428f-a2fb-28c64909ee1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:00.031889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3bb35-f116-428f-a2fb-28c64909ee1d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:00.044167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1158/2342] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:00.048576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:00.059387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d3342-6093-4057-a2fd-96f691704bc4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:00.066362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:00.067030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:00.067312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:00.067606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] PATH_INFO: `/v3/projects/ca8bd1fe4f5e465f8823316569f88803/users/6efd176b38ae48b3a1e5e9fd4fbeb12f/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:00.083944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8bd1fe4f5e465f8823316569f88803, user_id=6efd176b38ae48b3a1e5e9fd4fbeb12f, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:00.086622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:00.106254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1185/2343] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:00 2022] PUT /identity/v3/projects/ca8bd1fe4f5e465f8823316569f88803/users/6efd176b38ae48b3a1e5e9fd4fbeb12f/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:00.117038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:00.117318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:00.117721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:00.147883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] MFA Rules not processed for user `6efd176b38ae48b3a1e5e9fd4fbeb12f`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:00.149113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:00.218285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1159/2344] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:00.230264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:00.232651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:00.298781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4ab26-3462-4afb-a0e0-c34378f38c96 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:00.302844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9964a3-9d9e-4cf2-aeba-ef3c09f00595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:00.303681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9964a3-9d9e-4cf2-aeba-ef3c09f00595 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:00.304138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9964a3-9d9e-4cf2-aeba-ef3c09f00595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:00.304557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9964a3-9d9e-4cf2-aeba-ef3c09f00595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:00.315792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9964a3-9d9e-4cf2-aeba-ef3c09f00595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:00.317216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9964a3-9d9e-4cf2-aeba-ef3c09f00595 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:00.328520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1186/2345] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:03.080955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:03.082630 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:03.131772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:03.158040 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddff67-0d2c-42f0-9f4a-19d5293830f4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:03.171148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:03.171959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:03.172242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:03.172519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] PATH_INFO: `/v3/users/be57c2b0f9a844ea9567e15930b41353` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:03.174656 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be57c2b0f9a844ea9567e15930b41353)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:03.177502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:03.244363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be57c2b0f9a844ea9567e15930b41353'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:03.252206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be57c2b0f9a844ea9567e15930b41353'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:03.270653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be57c2b0f9a844ea9567e15930b41353'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:03.284269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be57c2b0f9a844ea9567e15930b41353'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:03.284981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be57c2b0f9a844ea9567e15930b41353'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:03.293562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1160/2346] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:03 2022] DELETE /identity/v3/users/be57c2b0f9a844ea9567e15930b41353 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:03.297007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bd848-0261-40dd-a9e8-c2b6673cd61b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:03.297481 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bd848-0261-40dd-a9e8-c2b6673cd61b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:03.297574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bd848-0261-40dd-a9e8-c2b6673cd61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:03.330790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-100bd848-0261-40dd-a9e8-c2b6673cd61b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:03.332108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-100bd848-0261-40dd-a9e8-c2b6673cd61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:03.386657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:03.411044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1187/2347] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:03.421594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:03.423196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:03.488525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087a4a2-4436-4186-aa0c-568b995cedd2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:03.492524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:03.493184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:03.493483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:03.494437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:03.507065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:03.508635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:03.522262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1161/2348] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:04.316360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:04.316810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:04.316894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:04.342370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:04.344158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:04.456779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1188/2349] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:04.515745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:04.516227 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:04.517243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:04.518613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:04.542892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7fb37-19af-48a3-9c68-7749322fc8d3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:04.575635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:04.576635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:04.577166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:04.577373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] PATH_INFO: `/v3/projects/4e02e98d2a89486c899987d052980ed2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:04.580951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e02e98d2a89486c899987d052980ed2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:04.582952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:04.686315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e02e98d2a89486c899987d052980ed2', 'request_id': 'req-7c11d7dd-0023-4bf3-bea7-582c59742d00'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:04.709998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e02e98d2a89486c899987d052980ed2', 'request_id': 'req-7c11d7dd-0023-4bf3-bea7-582c59742d00'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:04.723751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e02e98d2a89486c899987d052980ed2', 'request_id': 'req-7c11d7dd-0023-4bf3-bea7-582c59742d00'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:04.739047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:04.745209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7a446-ca8b-4dd0-a7f4-e5196010c0b6 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:04.749993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] The token cache is being invalidate because project 4e02e98d2a89486c899987d052980ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:04.751632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:04.753884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7c11d7dd-0023-4bf3-bea7-582c59742d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:04.758118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1189/2350] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:04 2022] DELETE /identity/v3/projects/4e02e98d2a89486c899987d052980ed2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:04.856693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:04.857433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:04.857713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:04.857982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:04.860196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:04.966910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:04.969297 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:05.000607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1162/2351] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:41:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:05.239470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:05.239815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:05.240309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:05.264939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:05.266607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:05.276255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1190/2352] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:05.295743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:05.297508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:05.321381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e725d0e-72cd-41f4-b254-261461bc4ac2 service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:05.328543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5105d-5a62-4c3a-878a-9f40c96499d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:05.329371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5105d-5a62-4c3a-878a-9f40c96499d3 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:05.329751 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5105d-5a62-4c3a-878a-9f40c96499d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:05.330147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5105d-5a62-4c3a-878a-9f40c96499d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:05.350105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5105d-5a62-4c3a-878a-9f40c96499d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:05.351972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5105d-5a62-4c3a-878a-9f40c96499d3 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:05.368009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1163/2353] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:41:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:05.708131 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:05.710438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:05.842440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894eeaa-2084-41ec-add8-fb18c2c5448c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:05.848408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:05.849319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:05.849752 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:05.850174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] PATH_INFO: `/v3/users/6efd176b38ae48b3a1e5e9fd4fbeb12f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:05.851785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efd176b38ae48b3a1e5e9fd4fbeb12f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:05.853890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:05.865160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:05.938108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efd176b38ae48b3a1e5e9fd4fbeb12f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:05.939140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efd176b38ae48b3a1e5e9fd4fbeb12f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:05.952945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efd176b38ae48b3a1e5e9fd4fbeb12f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:05.953874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efd176b38ae48b3a1e5e9fd4fbeb12f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:05.981753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efd176b38ae48b3a1e5e9fd4fbeb12f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:06.027954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1191/2354] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:05 2022] DELETE /identity/v3/users/6efd176b38ae48b3a1e5e9fd4fbeb12f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:06.033279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:06.033854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:06.033854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:06.089468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:06.090811 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:06.265051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1164/2355] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:06.272518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:06.275657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:06.478713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb40a-933c-490d-a862-8b78a36f3c7e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:06.485063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ec80f-ab25-4ef0-8233-f96f1ecbc1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:06.486078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec80f-ab25-4ef0-8233-f96f1ecbc1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:06.487011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec80f-ab25-4ef0-8233-f96f1ecbc1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:06.487567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec80f-ab25-4ef0-8233-f96f1ecbc1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:06.537290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec80f-ab25-4ef0-8233-f96f1ecbc1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:06.538713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ec80f-ab25-4ef0-8233-f96f1ecbc1f7 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:06.565662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1192/2356] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:06.930123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:06.931718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:06.967003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d943e5-24e4-4cbc-8001-7af30ef9abf8 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:06.979392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:06.980305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:06.980720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:06.990092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] PATH_INFO: `/v3/projects/ca8bd1fe4f5e465f8823316569f88803` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:06.992039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8bd1fe4f5e465f8823316569f88803)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:06.994231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:07.045825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:07.068163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8bd1fe4f5e465f8823316569f88803', 'request_id': 'req-32957257-7ebb-4df4-a6af-96f47940956b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:07.081894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8bd1fe4f5e465f8823316569f88803', 'request_id': 'req-32957257-7ebb-4df4-a6af-96f47940956b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:07.096970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8bd1fe4f5e465f8823316569f88803', 'request_id': 'req-32957257-7ebb-4df4-a6af-96f47940956b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:07.126092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] The token cache is being invalidate because project ca8bd1fe4f5e465f8823316569f88803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:07.127262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:07.128307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:07.131925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1165/2357] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:06 2022] DELETE /identity/v3/projects/ca8bd1fe4f5e465f8823316569f88803 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:07.770372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b8643-0aed-4c4b-9475-45779a4142a6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:07.770893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b8643-0aed-4c4b-9475-45779a4142a6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:07.771108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b8643-0aed-4c4b-9475-45779a4142a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:07.820145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8b9b8643-0aed-4c4b-9475-45779a4142a6 None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:07.821848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8b9b8643-0aed-4c4b-9475-45779a4142a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:07.923416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1193/2358] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:07.939032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:07.940750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:08.080261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32957257-7ebb-4df4-a6af-96f47940956b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:08.086659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:08.088146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:08.088384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:08.089146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:08.104752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:08.106836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:08.125139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1166/2359] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:41:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:08.442892 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4823f0-58aa-4682-9c30-39eaab7f8194 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:08.443177 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4823f0-58aa-4682-9c30-39eaab7f8194 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:08.443452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4823f0-58aa-4682-9c30-39eaab7f8194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:08.485370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cc4823f0-58aa-4682-9c30-39eaab7f8194 None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:08.486678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cc4823f0-58aa-4682-9c30-39eaab7f8194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:08.495558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1194/2360] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:08.518004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:08.553063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49b00-8ffe-4136-a9fe-189092e08bb2 service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:08.571210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:08.571210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:08.571210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:08.571970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:08.581910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:08.583708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:08.594121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1167/2361] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:09.272924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:09.273437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:09.273437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:09.303611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:09.305343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:09.331547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1195/2362] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:09.357116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:09.370416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cfc36-b42f-4b99-9012-8f4818e8d77f service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:09.375773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69356c3a-2615-45ec-b28e-5df2bdd5a0d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:09.376445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356c3a-2615-45ec-b28e-5df2bdd5a0d8 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:09.376887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356c3a-2615-45ec-b28e-5df2bdd5a0d8 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:09.377309 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69356c3a-2615-45ec-b28e-5df2bdd5a0d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:09.398314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69356c3a-2615-45ec-b28e-5df2bdd5a0d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:09.400358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69356c3a-2615-45ec-b28e-5df2bdd5a0d8 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:09.412377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1168/2363] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:41:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:11.930652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:11.932137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:11.974680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:12.054476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd043a-6d84-4139-ab24-0a734f86e8ed None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:12.059599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:12.060626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:12.061024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:12.061396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] PATH_INFO: `/v3/users/f564df75a4df4613ad8a8a1336ce5702` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:12.062956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f564df75a4df4613ad8a8a1336ce5702)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:12.065206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:12.140059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f564df75a4df4613ad8a8a1336ce5702'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:12.140793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f564df75a4df4613ad8a8a1336ce5702'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:12.159362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f564df75a4df4613ad8a8a1336ce5702'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:12.163178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f564df75a4df4613ad8a8a1336ce5702'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:12.200320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f564df75a4df4613ad8a8a1336ce5702'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:12.250002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201432-ef82-492a-8803-c55084eee50d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:12.250566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201432-ef82-492a-8803-c55084eee50d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:12.250566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd201432-ef82-492a-8803-c55084eee50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:12.253887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1196/2364] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:11 2022] DELETE /identity/v3/users/f564df75a4df4613ad8a8a1336ce5702 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:12.273968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fd201432-ef82-492a-8803-c55084eee50d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:12.275472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fd201432-ef82-492a-8803-c55084eee50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:12.379652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1169/2365] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:12.400296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:12.401764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:12.494249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90ec76-9994-4dac-90fb-f5d5aae02c8e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:12.498944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0852-a042-452d-ba2e-5a5706965b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:12.499809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0852-a042-452d-ba2e-5a5706965b77 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:12.500163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0852-a042-452d-ba2e-5a5706965b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:12.500513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0852-a042-452d-ba2e-5a5706965b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:12.511552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0852-a042-452d-ba2e-5a5706965b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:12.513261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0852-a042-452d-ba2e-5a5706965b77 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:12.525246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1197/2366] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:12.916676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd201432-ef82-492a-8803-c55084eee50d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:12.918413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fd201432-ef82-492a-8803-c55084eee50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:12.975211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd201432-ef82-492a-8803-c55084eee50d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:12.980908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:12.982436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:12.982920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:12.983253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] PATH_INFO: `/v3/projects/358aa1d7ff2e4bdbbb01ca08774b636a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:12.984706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=358aa1d7ff2e4bdbbb01ca08774b636a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:12.987345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:13.006845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:13.052397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358aa1d7ff2e4bdbbb01ca08774b636a', 'request_id': 'req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:13.061332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358aa1d7ff2e4bdbbb01ca08774b636a', 'request_id': 'req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:13.068838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358aa1d7ff2e4bdbbb01ca08774b636a', 'request_id': 'req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:13.081676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] The token cache is being invalidate because project 358aa1d7ff2e4bdbbb01ca08774b636a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:13.082337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:13.083162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ff5592ad-fbb9-45fb-bd5c-ba2f0e5bc3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:13.085201 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1170/2367] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:12 2022] DELETE /identity/v3/projects/358aa1d7ff2e4bdbbb01ca08774b636a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:13.090338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd049e-ece8-45f3-86df-7fb1b0c8802e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.091718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd049e-ece8-45f3-86df-7fb1b0c8802e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.091718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd049e-ece8-45f3-86df-7fb1b0c8802e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.117239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-55fd049e-ece8-45f3-86df-7fb1b0c8802e None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:13.118771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-55fd049e-ece8-45f3-86df-7fb1b0c8802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:13.168955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:13.203932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1198/2368] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:13.205661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5010e-e0ad-46c5-b09d-721028b9cd49 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.205952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5010e-e0ad-46c5-b09d-721028b9cd49 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.206234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5010e-e0ad-46c5-b09d-721028b9cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.252450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fef5010e-e0ad-46c5-b09d-721028b9cd49 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:13.254963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fef5010e-e0ad-46c5-b09d-721028b9cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:13.276392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd049e-ece8-45f3-86df-7fb1b0c8802e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:13.288367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1171/2369] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:41:13.290703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd049e-ece8-45f3-86df-7fb1b0c8802e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:13.298247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:13.298994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.299335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.300106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.300989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:41:13.301440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:13.303195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:13.350145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1199/2370] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:41:13.355218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5010e-e0ad-46c5-b09d-721028b9cd49 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:13.375135 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5010e-e0ad-46c5-b09d-721028b9cd49 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:13.381023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:13.381996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.382517 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.383232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.384094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:13.386217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:13.433147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1172/2371] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:41:13 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:13.433971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:13.448764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5ef8-8b5e-4dab-bf7d-5935200d794e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:13.625437 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:13.626063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.626420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.626654 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.627287 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:13.629466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:13.666286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1200/2372] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:41:13 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:13.670106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:13.685273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46baf4-d00a-43f5-89f9-fa8bda4e10c9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:13.700429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:13.701604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.702769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.705664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.706503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:13.711155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:13.736056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1173/2373] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:13.737147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:13.751656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f75dd-a46c-4d7b-b4e0-b6464abb08c4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:13.757737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b922-17bb-420c-9e41-f1261b572f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:13.758846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b922-17bb-420c-9e41-f1261b572f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.759133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b922-17bb-420c-9e41-f1261b572f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.759407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b922-17bb-420c-9e41-f1261b572f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.760195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02b922-17bb-420c-9e41-f1261b572f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:13.762019 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02b922-17bb-420c-9e41-f1261b572f50 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:13.789771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1201/2374] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:13.794435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:13.817275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f391c-2e7c-4bec-b491-d22227973bf0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:13.830007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:13.832350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.833898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.834311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] PATH_INFO: `/v3/projects/e5fcb2a0adcd41649faac787794d4812/users/94dd7e27d6c64f849a1efb3d32dc4fa4/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.881295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5fcb2a0adcd41649faac787794d4812, user_id=94dd7e27d6c64f849a1efb3d32dc4fa4, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:13.895927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:13.922158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1174/2375] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:13 2022] PUT /identity/v3/projects/e5fcb2a0adcd41649faac787794d4812/users/94dd7e27d6c64f849a1efb3d32dc4fa4/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:13.923929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ef26f-a226-495f-bca7-f008fd78cccc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:13.924209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ef26f-a226-495f-bca7-f008fd78cccc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:13.924490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ef26f-a226-495f-bca7-f008fd78cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:13.983712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-819ef26f-a226-495f-bca7-f008fd78cccc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:13.985017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-819ef26f-a226-495f-bca7-f008fd78cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:14.102214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1202/2376] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:14.118519 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:14.122552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:14.232931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef6080-f3a3-4a2f-a13b-de038cae863f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:14.251463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:14.251463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:14.251463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:14.251463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:14.252115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:14.253686 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:14.276485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1175/2377] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:21.363953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818fc4f-bcae-4a57-a9b5-ecf72ae98803 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:21.364524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818fc4f-bcae-4a57-a9b5-ecf72ae98803 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:21.364524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818fc4f-bcae-4a57-a9b5-ecf72ae98803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:21.399267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0818fc4f-bcae-4a57-a9b5-ecf72ae98803 None None] MFA Rules not processed for user `94dd7e27d6c64f849a1efb3d32dc4fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:21.402119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0818fc4f-bcae-4a57-a9b5-ecf72ae98803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:21.468140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:21.509405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1203/2378] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:21.510585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:21.521418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c850-92e2-4119-8c31-94c86468f76d service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:21.526455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:21.527142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:21.527492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:21.527884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:21.528789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:21.530914 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:21.565705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1176/2379] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:41:21 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:21.569723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818fc4f-bcae-4a57-a9b5-ecf72ae98803 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:21.583893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818fc4f-bcae-4a57-a9b5-ecf72ae98803 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:21.664023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:21.664690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:21.665044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:21.669251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:21.669949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:21.671995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:21.698698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1204/2380] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:41:21 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:21.702911 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:21.713664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a5c41-f6da-4dbe-83f3-154296384cd9 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:21.719446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:21.720219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:21.720500 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:21.720778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:21.721502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:21.723068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:21.736694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1177/2381] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:41:21.740712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:21.753903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bfb0a-adcf-4a94-8f84-dc29bbdf796d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:21.759516 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:21.760316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:21.761358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:21.761358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] PATH_INFO: `/v3/projects/e8481c01807d4717ac836d0a6742e6d4/users/873dd06cba5241c58f58be1052d53b42/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:21.779144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8481c01807d4717ac836d0a6742e6d4, user_id=873dd06cba5241c58f58be1052d53b42, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:21.781780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:21.806273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1205/2382] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:21 2022] PUT /identity/v3/projects/e8481c01807d4717ac836d0a6742e6d4/users/873dd06cba5241c58f58be1052d53b42/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:41:21.807794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:21.819627 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aac0a-cef8-47cd-980e-2499d9c40a57 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:21.825539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:21.899546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:21.900221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:21.900669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:21.900999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:21.901651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:21.903318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:21.920599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1178/2383] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:41:21.924716 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:21.937370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe60b3-12dd-4a4e-ade0-deebecadada7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:21.943781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cda49-d82f-4daa-a859-2b8ebb64ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:21.944890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cda49-d82f-4daa-a859-2b8ebb64ad32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:21.945133 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cda49-d82f-4daa-a859-2b8ebb64ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:21.945416 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cda49-d82f-4daa-a859-2b8ebb64ad32 admin admin] PATH_INFO: `/v3/projects/e8481c01807d4717ac836d0a6742e6d4/users/873dd06cba5241c58f58be1052d53b42/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:21.947742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cda49-d82f-4daa-a859-2b8ebb64ad32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8481c01807d4717ac836d0a6742e6d4, user_id=873dd06cba5241c58f58be1052d53b42, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:21.951070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cda49-d82f-4daa-a859-2b8ebb64ad32 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:21.966000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1206/2384] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:21 2022] PUT /identity/v3/projects/e8481c01807d4717ac836d0a6742e6d4/users/873dd06cba5241c58f58be1052d53b42/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:21.972903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:21.975310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:21.988877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e450e-f1eb-4793-af58-c0665016604c admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:22.096956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:22.097489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:22.097957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:22.098243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] PATH_INFO: `/v3/users/eb463c9680d64e53affb1ab8d4e7a6f6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:22.105483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb463c9680d64e53affb1ab8d4e7a6f6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:22.105483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:22.183204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb463c9680d64e53affb1ab8d4e7a6f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:22.195921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb463c9680d64e53affb1ab8d4e7a6f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:22.211982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb463c9680d64e53affb1ab8d4e7a6f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:22.231417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb463c9680d64e53affb1ab8d4e7a6f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:22.232590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb463c9680d64e53affb1ab8d4e7a6f6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:22.241764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1179/2385] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:21 2022] DELETE /identity/v3/users/eb463c9680d64e53affb1ab8d4e7a6f6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:41:22.247125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:22.247486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:22.247972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:22.271186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:22.274124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:22.396183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1207/2386] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:22.424541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:22.428908 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:22.493256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:22.581664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a100dc-d8ee-4b28-a00a-635b06a6b958 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:22.591006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:22.595286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:22.596061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:22.596545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:22.615872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:22.620373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:22.647391 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1180/2387] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:23.225718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:23.227199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:23.248690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b77e-d31b-45e9-bb52-e875323f2c32 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:23.265577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:23.266243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:23.266521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:23.266792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] PATH_INFO: `/v3/projects/dab8f88753534f25b68446b86adb5f46` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:23.268025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab8f88753534f25b68446b86adb5f46)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:23.270079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:23.341282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:23.397022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab8f88753534f25b68446b86adb5f46', 'request_id': 'req-db3326b3-811e-4943-bfaf-bec6c17f2cb8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:23.418116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab8f88753534f25b68446b86adb5f46', 'request_id': 'req-db3326b3-811e-4943-bfaf-bec6c17f2cb8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:23.429652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab8f88753534f25b68446b86adb5f46', 'request_id': 'req-db3326b3-811e-4943-bfaf-bec6c17f2cb8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:23.467243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] The token cache is being invalidate because project dab8f88753534f25b68446b86adb5f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:23.467605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:23.472776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:23.486358 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1208/2388] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:23 2022] DELETE /identity/v3/projects/dab8f88753534f25b68446b86adb5f46 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:24.436979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:24.438979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:24.501745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c0fae-3364-40c3-84be-6cbbe421796d service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:24.722715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:24.723835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:24.724324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:24.724783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] PATH_INFO: `/v3/users/f2448018820b47eaa95a42903fe85693` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:24.728526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2448018820b47eaa95a42903fe85693)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:24.732530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:24.834523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2448018820b47eaa95a42903fe85693'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:24.849244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2448018820b47eaa95a42903fe85693'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:24.881329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2448018820b47eaa95a42903fe85693'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:24.896213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2448018820b47eaa95a42903fe85693'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:24.897580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2448018820b47eaa95a42903fe85693'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:24.910345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1181/2389] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:24 2022] DELETE /identity/v3/users/f2448018820b47eaa95a42903fe85693 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:25.349379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:25.353350 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:25.403462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3326b3-811e-4943-bfaf-bec6c17f2cb8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:25.550261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:25.551126 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:25.551643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:25.552060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] PATH_INFO: `/v3/projects/9c995579160b4541abc7825354a5cd1a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:25.554373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c995579160b4541abc7825354a5cd1a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:25.556758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:25.666511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c995579160b4541abc7825354a5cd1a', 'request_id': 'req-f7164486-1946-43a6-b00a-b219a8062307'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:25.678426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c995579160b4541abc7825354a5cd1a', 'request_id': 'req-f7164486-1946-43a6-b00a-b219a8062307'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:25.712216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c995579160b4541abc7825354a5cd1a', 'request_id': 'req-f7164486-1946-43a6-b00a-b219a8062307'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:25.738365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] The token cache is being invalidate because project 9c995579160b4541abc7825354a5cd1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:25.738663 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:25.739386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f7164486-1946-43a6-b00a-b219a8062307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:25.746272 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:25.748076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:25.750136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1209/2390] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:25 2022] DELETE /identity/v3/projects/9c995579160b4541abc7825354a5cd1a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:25.770922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a1d9-34ce-43f0-a821-903a7267dd35 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:25.862180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:25.896659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:25.898254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:25.902824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:25.902824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] PATH_INFO: `/v3/users/8a6948525b0e4302a8a874f1371a8fd5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:25.905869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6948525b0e4302a8a874f1371a8fd5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:25.908029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:26.009462 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6948525b0e4302a8a874f1371a8fd5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:26.019806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6948525b0e4302a8a874f1371a8fd5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:26.058446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6948525b0e4302a8a874f1371a8fd5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:26.074314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6948525b0e4302a8a874f1371a8fd5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:26.075284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-71ccd05b-18f9-4290-9ef8-ad9ce82214fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6948525b0e4302a8a874f1371a8fd5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:26.085181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1182/2391] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:25 2022] DELETE /identity/v3/users/8a6948525b0e4302a8a874f1371a8fd5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:26.283020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c44ec-3f45-4c94-8ee5-3b5d7db8c602 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:26.283426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c44ec-3f45-4c94-8ee5-3b5d7db8c602 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:26.283749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c44ec-3f45-4c94-8ee5-3b5d7db8c602 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:26.285460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1210/2392] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:41:26.292130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:26.292983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:26.293429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:26.345917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:26.348015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:26.491669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1183/2393] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:26.505950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c44ec-3f45-4c94-8ee5-3b5d7db8c602 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:26.508521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4a0c44ec-3f45-4c94-8ee5-3b5d7db8c602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:26.610148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:26.632179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c44ec-3f45-4c94-8ee5-3b5d7db8c602 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:26.643100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48fbb1-7bb4-462e-be97-cea84ffff413 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a331472a0040d68824a2245bf3e716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:26.643745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48fbb1-7bb4-462e-be97-cea84ffff413 service glance] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:26.643995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48fbb1-7bb4-462e-be97-cea84ffff413 service glance] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:26.644439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48fbb1-7bb4-462e-be97-cea84ffff413 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:26.676213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48fbb1-7bb4-462e-be97-cea84ffff413 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:26.677739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48fbb1-7bb4-462e-be97-cea84ffff413 service glance] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:26.722319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1211/2394] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:26.832929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:26.834943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:26.879141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f266-ad32-462e-b1ed-f0a258098e7a None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:26.879884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f266-ad32-462e-b1ed-f0a258098e7a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:26.880579 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1f266-ad32-462e-b1ed-f0a258098e7a None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:26.881898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1212/2395] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:41:26.887022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:26.887392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:26.888052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:26.944786 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] MFA Rules not processed for user `2fdb46b5aa2c477d8abce5a1eb9fb68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:26.946188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:26.973795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:26.985938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18245b6-cf65-45ed-bb49-b31cd8916237 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:26.993088 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:26.999986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:26.999986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:26.999986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] PATH_INFO: `/v3/projects/b697d0e7ce5e44a48fefa67f23aa29ee` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.001120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b697d0e7ce5e44a48fefa67f23aa29ee)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.003429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.063496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1213/2396] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:27.076466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.081690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:27.093766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b697d0e7ce5e44a48fefa67f23aa29ee', 'request_id': 'req-c612b96a-94a7-4046-8484-15c6c3b4555c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:27.104588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3549fb5-dad4-47f8-9669-48660f229daf None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.110606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b697d0e7ce5e44a48fefa67f23aa29ee', 'request_id': 'req-c612b96a-94a7-4046-8484-15c6c3b4555c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:27.119821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b697d0e7ce5e44a48fefa67f23aa29ee', 'request_id': 'req-c612b96a-94a7-4046-8484-15c6c3b4555c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:27.136533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] The token cache is being invalidate because project b697d0e7ce5e44a48fefa67f23aa29ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:27.136830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:27.138594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c612b96a-94a7-4046-8484-15c6c3b4555c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:27.141551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1184/2397] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:26 2022] DELETE /identity/v3/projects/b697d0e7ce5e44a48fefa67f23aa29ee => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:27.146211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f98d8-adc1-4557-8572-f1db2fff3209 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.146490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f98d8-adc1-4557-8572-f1db2fff3209 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.146766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f98d8-adc1-4557-8572-f1db2fff3209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.178454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d3b18-bf8e-4358-9e81-6fc4b3dec295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.178888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d3b18-bf8e-4358-9e81-6fc4b3dec295 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.179165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d3b18-bf8e-4358-9e81-6fc4b3dec295 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.179435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d3b18-bf8e-4358-9e81-6fc4b3dec295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.181338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f31d3b18-bf8e-4358-9e81-6fc4b3dec295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:27.192402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d3b18-bf8e-4358-9e81-6fc4b3dec295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.194060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d3b18-bf8e-4358-9e81-6fc4b3dec295 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.196195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4c5f98d8-adc1-4557-8572-f1db2fff3209 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:27.197614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4c5f98d8-adc1-4557-8572-f1db2fff3209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:27.222288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1214/2398] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:27.282251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1185/2399] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:27.283389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80491a3a-f708-453f-a241-462c82963f99 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.284288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80491a3a-f708-453f-a241-462c82963f99 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.284572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80491a3a-f708-453f-a241-462c82963f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.317334 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-80491a3a-f708-453f-a241-462c82963f99 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:27.319252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-80491a3a-f708-453f-a241-462c82963f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:27.331237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1215/2400] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:27.336194 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f98d8-adc1-4557-8572-f1db2fff3209 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.349657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f98d8-adc1-4557-8572-f1db2fff3209 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.357080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8a045-54d5-46ed-89ca-e06156c8c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.357722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8a045-54d5-46ed-89ca-e06156c8c185 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.358004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8a045-54d5-46ed-89ca-e06156c8c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.358281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8a045-54d5-46ed-89ca-e06156c8c185 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.358958 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8a045-54d5-46ed-89ca-e06156c8c185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:41:27.359267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8a045-54d5-46ed-89ca-e06156c8c185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.360977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8a045-54d5-46ed-89ca-e06156c8c185 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.375221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1186/2401] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:41:27.379910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80491a3a-f708-453f-a241-462c82963f99 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.392347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2af357-90d2-49d3-a8fd-84e6d51a4fc2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.392690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2af357-90d2-49d3-a8fd-84e6d51a4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.392900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2af357-90d2-49d3-a8fd-84e6d51a4fc2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.397173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80491a3a-f708-453f-a241-462c82963f99 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.398601 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1187/2402] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:41:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:41:27.400783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.401069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.401343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.408347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.408993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.409265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.409537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.410176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.412155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.436541 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:27.437945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:27.467911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1216/2403] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:41:27 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:41:27.471872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.551302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1188/2404] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:27.561590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc4c6-d0ea-4ffe-a857-066726eab2ff admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.563909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.565682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:27.577100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.577624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.577787 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.578051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.578805 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.579280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b88ca0-9d24-419c-a962-9f1d82989ca3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.581498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.583240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:27.605092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:27.616354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1217/2405] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:41:27 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:27.618072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.632212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1aa41-c059-4753-817e-5f3bb3784719 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.638118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.638794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.639148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.639425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.641186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.642913 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.655944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1218/2406] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:27.660130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.671724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.672544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.673111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.673359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.678378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16589e9-ccf2-41e4-a020-9374b03a45bf admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.689630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.690297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.690640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.690974 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.691721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.693562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.709758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1219/2407] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:27.712644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:27.726405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328f40f-f478-4f5a-85c1-6042026e4fca admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:27.731723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fffa5-cd78-4b7f-b5e5-9ec55bbbd2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:27.732530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fffa5-cd78-4b7f-b5e5-9ec55bbbd2df admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.732806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fffa5-cd78-4b7f-b5e5-9ec55bbbd2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.733074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fffa5-cd78-4b7f-b5e5-9ec55bbbd2df admin admin] PATH_INFO: `/v3/projects/97059b3c428c4dd5bb97855740c92c4d/users/4a4bd461a5db4c2e85ddddce7573f2ce/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.755305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fffa5-cd78-4b7f-b5e5-9ec55bbbd2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=97059b3c428c4dd5bb97855740c92c4d, user_id=4a4bd461a5db4c2e85ddddce7573f2ce, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.759282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fffa5-cd78-4b7f-b5e5-9ec55bbbd2df admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.787109 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1220/2408] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:27 2022] PUT /identity/v3/projects/97059b3c428c4dd5bb97855740c92c4d/users/4a4bd461a5db4c2e85ddddce7573f2ce/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:27.798209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda987-bd8a-47b9-a889-628a4571643f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:27.798576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda987-bd8a-47b9-a889-628a4571643f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:27.798899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda987-bd8a-47b9-a889-628a4571643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:27.846111 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:27.848092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:27.869946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c7dda987-bd8a-47b9-a889-628a4571643f None None] MFA Rules not processed for user `4a4bd461a5db4c2e85ddddce7573f2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:27.871448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7dda987-bd8a-47b9-a889-628a4571643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:27.878721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1189/2409] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:27.973280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1221/2410] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:41:27.977791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:28.014237 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a30de2-0872-4702-bf07-d9a82233fad6 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:28.110931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:28.110931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:28.111285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:28.111466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:28.112725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:28.114433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:28.152319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1190/2411] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:41:27 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:28.156451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda987-bd8a-47b9-a889-628a4571643f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:28.176897 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda987-bd8a-47b9-a889-628a4571643f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:28.296056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:28.296700 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:28.296986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:28.297316 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:28.298010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:28.300207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:28.359018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1222/2412] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:41:28 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:28.364507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:28.378686 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1209dc-86de-4638-820f-f4d15ad7cd2a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:28.387638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:28.388318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:28.388698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:28.389093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:28.390967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:28.393256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:28.427121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1191/2413] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:28.430766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:28.443168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caed498-d02b-400e-944e-ec480d7c305e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:28.454522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f38a1-2204-4718-acdd-56d36ef30a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:28.455164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f38a1-2204-4718-acdd-56d36ef30a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:28.455451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f38a1-2204-4718-acdd-56d36ef30a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:28.456121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f38a1-2204-4718-acdd-56d36ef30a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:28.456429 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f38a1-2204-4718-acdd-56d36ef30a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:28.458117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f38a1-2204-4718-acdd-56d36ef30a79 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:28.479638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1223/2414] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:28.483813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:28.498722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9800c-4497-48de-84a0-b7a9638919e1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:28.515470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:28.516290 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:28.516635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:28.516966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] PATH_INFO: `/v3/projects/2b45eee9f74a420a959b2642509cc463/users/cc39fbd3752d4c859acb1776a14351bb/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:28.592941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b45eee9f74a420a959b2642509cc463, user_id=cc39fbd3752d4c859acb1776a14351bb, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:28.595745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:28.611222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:28.624481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1192/2415] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:28 2022] PUT /identity/v3/projects/2b45eee9f74a420a959b2642509cc463/users/cc39fbd3752d4c859acb1776a14351bb/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:41:28.639764 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b18a1-6680-457f-a68a-ec1add1baebd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:28.640616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b18a1-6680-457f-a68a-ec1add1baebd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:28.640734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b18a1-6680-457f-a68a-ec1add1baebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:28.680030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a49b18a1-6680-457f-a68a-ec1add1baebd None None] MFA Rules not processed for user `cc39fbd3752d4c859acb1776a14351bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:28.681978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a49b18a1-6680-457f-a68a-ec1add1baebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:28.694584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:28.857432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1224/2416] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:28.858849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:28.948628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cecf7-0a64-4157-b754-4cd41015ff66 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:28.954271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:28.954895 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:28.955170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:28.955435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:28.956098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:28.958039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:28.992182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1193/2417] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:41:28 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:28.993315 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b18a1-6680-457f-a68a-ec1add1baebd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:29.008601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b18a1-6680-457f-a68a-ec1add1baebd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:29.096147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:29.096908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.097184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.097452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.098101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:29.100995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:29.128634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1225/2418] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:41:28 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:29.132888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:29.157599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b3550-f9dd-4030-bde9-d1047d88392e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:29.181840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:29.185123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.188025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.188539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.190570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:29.193520 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:29.224902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1194/2419] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:29.226174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:29.239447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e8100-8941-4276-83ea-9182e39ff177 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:29.264300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:29.265186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.265474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.265748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] PATH_INFO: `/v3/projects/903f8be89e824192aed84672f4ee45ba/users/ab3e46a5bff046bda5ea05f0ad090a5e/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.293185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903f8be89e824192aed84672f4ee45ba, user_id=ab3e46a5bff046bda5ea05f0ad090a5e, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:29.296459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:29.330549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1226/2420] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:29 2022] PUT /identity/v3/projects/903f8be89e824192aed84672f4ee45ba/users/ab3e46a5bff046bda5ea05f0ad090a5e/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:29.334591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:29.346149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ef93c-80a1-4240-9bec-2c3edae04570 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:29.533076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8680d4-d222-45fd-adb1-a1a27a4ad889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:29.534038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8680d4-d222-45fd-adb1-a1a27a4ad889 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.534596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8680d4-d222-45fd-adb1-a1a27a4ad889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.534869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8680d4-d222-45fd-adb1-a1a27a4ad889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.535567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8680d4-d222-45fd-adb1-a1a27a4ad889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:29.537247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8680d4-d222-45fd-adb1-a1a27a4ad889 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:29.553054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1195/2421] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:29.556326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:29.574127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac40ba9-e5e8-45f1-8ebf-b08c5aa11303 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:29.582980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cb48e-4835-41fe-bc5f-64fafe667ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:29.583717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb48e-4835-41fe-bc5f-64fafe667ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.584127 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb48e-4835-41fe-bc5f-64fafe667ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.584421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cb48e-4835-41fe-bc5f-64fafe667ba8 admin admin] PATH_INFO: `/v3/projects/903f8be89e824192aed84672f4ee45ba/users/ab3e46a5bff046bda5ea05f0ad090a5e/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.595155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cb48e-4835-41fe-bc5f-64fafe667ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903f8be89e824192aed84672f4ee45ba, user_id=ab3e46a5bff046bda5ea05f0ad090a5e, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:29.598193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967cb48e-4835-41fe-bc5f-64fafe667ba8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:29.631453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1227/2422] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:29 2022] PUT /identity/v3/projects/903f8be89e824192aed84672f4ee45ba/users/ab3e46a5bff046bda5ea05f0ad090a5e/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:29.643747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.644922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.644922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.685925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] MFA Rules not processed for user `ab3e46a5bff046bda5ea05f0ad090a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:29.687256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:29.715134 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.715681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.715771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.751020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] MFA Rules not processed for user `873dd06cba5241c58f58be1052d53b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:29.752556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:29.758709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:29.773572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1196/2423] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:29.785516 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:29.787977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:29.862220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:29.888570 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1228/2424] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:29.901638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4693e5b-081c-415a-81e3-af08484cff65 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:29.903132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:29.904846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:29.906808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1d756-66a2-4179-84ca-b6fa3a1e321e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:29.907095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d756-66a2-4179-84ca-b6fa3a1e321e service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:29.907533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d756-66a2-4179-84ca-b6fa3a1e321e service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:29.907904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d756-66a2-4179-84ca-b6fa3a1e321e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:29.993785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1d756-66a2-4179-84ca-b6fa3a1e321e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:29.995528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1d756-66a2-4179-84ca-b6fa3a1e321e service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:29.996398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea9df3-b7fd-498b-9808-b093b1a13fdb None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:30.004435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:30.005222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:30.006132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:30.006598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:30.008653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1197/2425] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:41:30.008890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:30.107118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:30.112761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:30.125889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1229/2426] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:41:31.190485 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e53243-d829-4001-ae39-1e46e704cc2b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:31.191030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e53243-d829-4001-ae39-1e46e704cc2b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:31.191123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e53243-d829-4001-ae39-1e46e704cc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:31.213027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-81e53243-d829-4001-ae39-1e46e704cc2b None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:31.214345 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-81e53243-d829-4001-ae39-1e46e704cc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:31.276946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1198/2427] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:31.289891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:31.291438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:31.376446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e075-850e-49f6-a676-cf304ee13109 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:31.382407 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:31.383128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:31.383447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:31.383790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:31.393096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:31.394724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:31.403674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1230/2428] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:41:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:41:31.427402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967c964-6d2a-4a2b-85cc-a941b4992f17 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:31.427729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967c964-6d2a-4a2b-85cc-a941b4992f17 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:31.428010 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967c964-6d2a-4a2b-85cc-a941b4992f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:31.449121 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a967c964-6d2a-4a2b-85cc-a941b4992f17 None None] MFA Rules not processed for user `94dd7e27d6c64f849a1efb3d32dc4fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:31.450381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a967c964-6d2a-4a2b-85cc-a941b4992f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:31.457863 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1199/2429] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:31.790190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:31.807216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27a0da-a5ea-40c4-aeef-04e5806f11c3 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:31.818761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:31.819909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:31.819909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:31.820111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:31.837387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:31.900521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:31.902280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:31.916563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1231/2430] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:32.996327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967c964-6d2a-4a2b-85cc-a941b4992f17 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:33.009459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967c964-6d2a-4a2b-85cc-a941b4992f17 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:33.016972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929ce4-7f8e-40f4-b71d-69c2e071cf22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:33.017612 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929ce4-7f8e-40f4-b71d-69c2e071cf22 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:33.017872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929ce4-7f8e-40f4-b71d-69c2e071cf22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:33.018140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929ce4-7f8e-40f4-b71d-69c2e071cf22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:33.042068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16929ce4-7f8e-40f4-b71d-69c2e071cf22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:33.043876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16929ce4-7f8e-40f4-b71d-69c2e071cf22 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:33.063016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1200/2431] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:37.314443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:37.386720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ffc58-4c46-4334-9db3-ff8974498ccf service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:37.393507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:37.394166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:37.394443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:37.394712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] PATH_INFO: `/v3/users/4a4bd461a5db4c2e85ddddce7573f2ce` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:37.395964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4bd461a5db4c2e85ddddce7573f2ce)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:37.397910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:37.454647 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4bd461a5db4c2e85ddddce7573f2ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:37.455520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4bd461a5db4c2e85ddddce7573f2ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:37.470742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4bd461a5db4c2e85ddddce7573f2ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:37.471594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4bd461a5db4c2e85ddddce7573f2ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:37.492905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4bd461a5db4c2e85ddddce7573f2ce'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:37.537266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1232/2432] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:37 2022] DELETE /identity/v3/users/4a4bd461a5db4c2e85ddddce7573f2ce => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:37.543056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:37.544676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:37.544676 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:37.574341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:37.575938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:37.615265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:37.655051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1201/2433] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:37.665563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:37.667448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:37.710288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:37.755738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f5d6d-c344-48a6-a85b-0c72fc6160a4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:37.760160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:37.760863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:37.761150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:37.761423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:37.772676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:37.774269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:37.785853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1233/2434] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:41:38.266939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:38.268923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:38.286529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb468-702c-489d-abe5-636f80ec3bd4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:38.292793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:38.293635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:38.294410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:38.294410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] PATH_INFO: `/v3/projects/97059b3c428c4dd5bb97855740c92c4d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:38.296253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97059b3c428c4dd5bb97855740c92c4d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:38.298492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:38.365359 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97059b3c428c4dd5bb97855740c92c4d', 'request_id': 'req-4ff0efae-1318-4f29-bb0e-45fdcb305712'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.375377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97059b3c428c4dd5bb97855740c92c4d', 'request_id': 'req-4ff0efae-1318-4f29-bb0e-45fdcb305712'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.382753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97059b3c428c4dd5bb97855740c92c4d', 'request_id': 'req-4ff0efae-1318-4f29-bb0e-45fdcb305712'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.397387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] The token cache is being invalidate because project 97059b3c428c4dd5bb97855740c92c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:38.397677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.398375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.399916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1202/2435] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:38 2022] DELETE /identity/v3/projects/97059b3c428c4dd5bb97855740c92c4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:38.404280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:38.415178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7f9a8-4e99-40da-ab72-f8f120c874cb service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:38.487743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:38.488877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:38.489157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:38.489426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] PATH_INFO: `/v3/users/cc39fbd3752d4c859acb1776a14351bb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:38.490818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc39fbd3752d4c859acb1776a14351bb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:38.492826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:38.581366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc39fbd3752d4c859acb1776a14351bb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.582083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc39fbd3752d4c859acb1776a14351bb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.589732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc39fbd3752d4c859acb1776a14351bb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.590435 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc39fbd3752d4c859acb1776a14351bb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.600500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc39fbd3752d4c859acb1776a14351bb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:38.621800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1234/2436] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:38 2022] DELETE /identity/v3/users/cc39fbd3752d4c859acb1776a14351bb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:38.946690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:38.948252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:38.962965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0efae-1318-4f29-bb0e-45fdcb305712 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:39.041269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:39.042242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:39.042692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:39.043114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] PATH_INFO: `/v3/projects/2b45eee9f74a420a959b2642509cc463` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:39.048197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b45eee9f74a420a959b2642509cc463)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:39.051790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:39.115650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b45eee9f74a420a959b2642509cc463', 'request_id': 'req-de5d0373-735c-4170-82cd-243b770a0e01'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.124597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b45eee9f74a420a959b2642509cc463', 'request_id': 'req-de5d0373-735c-4170-82cd-243b770a0e01'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.128269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:39.136752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b45eee9f74a420a959b2642509cc463', 'request_id': 'req-de5d0373-735c-4170-82cd-243b770a0e01'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.150206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] The token cache is being invalidate because project 2b45eee9f74a420a959b2642509cc463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:39.150664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.151545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.154424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1203/2437] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:38 2022] DELETE /identity/v3/projects/2b45eee9f74a420a959b2642509cc463 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:39.158263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:39.161491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:39.190621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca406-daf7-4c08-a9ab-891552157586 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:39.289544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:39.314060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:39.314742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:39.315003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:39.315273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] PATH_INFO: `/v3/users/ab3e46a5bff046bda5ea05f0ad090a5e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:39.316800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3e46a5bff046bda5ea05f0ad090a5e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:39.318770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:39.393096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3e46a5bff046bda5ea05f0ad090a5e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.393821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3e46a5bff046bda5ea05f0ad090a5e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.402467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3e46a5bff046bda5ea05f0ad090a5e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.403430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3e46a5bff046bda5ea05f0ad090a5e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.420524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4e1fa5b0-dfb9-41e4-9fec-10b1d8944fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3e46a5bff046bda5ea05f0ad090a5e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:39.456863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1235/2438] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:41:39 2022] DELETE /identity/v3/users/ab3e46a5bff046bda5ea05f0ad090a5e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:39.843103 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:39.845358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:39.866966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d0373-735c-4170-82cd-243b770a0e01 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:39.939320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:39.940016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:39.940314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:39.940576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] PATH_INFO: `/v3/projects/903f8be89e824192aed84672f4ee45ba` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:39.941732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903f8be89e824192aed84672f4ee45ba)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:39.943899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:39.999504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903f8be89e824192aed84672f4ee45ba', 'request_id': 'req-f6f7f618-3462-4c95-bf1a-ef871cf508a5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:40.008062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903f8be89e824192aed84672f4ee45ba', 'request_id': 'req-f6f7f618-3462-4c95-bf1a-ef871cf508a5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:40.015425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903f8be89e824192aed84672f4ee45ba', 'request_id': 'req-f6f7f618-3462-4c95-bf1a-ef871cf508a5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:40.026674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] The token cache is being invalidate because project 903f8be89e824192aed84672f4ee45ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:41:40.026968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:40.027661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f6f7f618-3462-4c95-bf1a-ef871cf508a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:41:40.029421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1204/2439] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:41:39 2022] DELETE /identity/v3/projects/903f8be89e824192aed84672f4ee45ba => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:40.034575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2ea8-3d7d-4df3-aee2-2805d131d1f2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.034925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2ea8-3d7d-4df3-aee2-2805d131d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.035205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2ea8-3d7d-4df3-aee2-2805d131d1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.056551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-583f2ea8-3d7d-4df3-aee2-2805d131d1f2 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:40.057834 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-583f2ea8-3d7d-4df3-aee2-2805d131d1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:40.123208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1236/2440] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:40.196590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5515cd5-d2cf-41d4-98bc-a637956d6311 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.196998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5515cd5-d2cf-41d4-98bc-a637956d6311 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.197407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5515cd5-d2cf-41d4-98bc-a637956d6311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.227557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a5515cd5-d2cf-41d4-98bc-a637956d6311 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:40.228833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a5515cd5-d2cf-41d4-98bc-a637956d6311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:40.249745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1205/2441] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:40.254307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2ea8-3d7d-4df3-aee2-2805d131d1f2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:40.266580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f2ea8-3d7d-4df3-aee2-2805d131d1f2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:40.272676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:40.273552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.274978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.274978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.275216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:41:40.275423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:40.277418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:40.297438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5515cd5-d2cf-41d4-98bc-a637956d6311 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:40.299731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1237/2442] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:41:40.309907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5515cd5-d2cf-41d4-98bc-a637956d6311 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:40.315181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:40.315963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.316182 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.316458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.317097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:40.319079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:40.364113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1206/2443] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:41:40 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:41:40.365368 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:40.376766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1edc33-a73b-4961-88a9-00387c6d9e79 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:40.441216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:40.441912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.442150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.442394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.443142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:40.445254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:40.455562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:40.471504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1238/2444] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:41:40 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:41:40.476397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:40.487543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766660e-e92e-48f5-a8e0-f51afa965d32 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:40.492611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:40.493235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.493514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.493782 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.494468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:40.496126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:40.514406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1207/2445] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:41:40.517459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:40.537612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb4dc4-9fe7-4d9d-9fe3-ab9304034f8b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:40.537612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff9e5b-f618-4e3a-9aba-29d4128a1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:40.538762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff9e5b-f618-4e3a-9aba-29d4128a1aad admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.539111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff9e5b-f618-4e3a-9aba-29d4128a1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.539452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff9e5b-f618-4e3a-9aba-29d4128a1aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.540223 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff9e5b-f618-4e3a-9aba-29d4128a1aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:40.543620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff9e5b-f618-4e3a-9aba-29d4128a1aad admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:40.567972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1239/2446] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:41:40.570964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:40.587048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956a5c7-a38f-4f21-9c23-f20bd5f1c4ee admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:40.605130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:40.606093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.606564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.606985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] PATH_INFO: `/v3/projects/0d0bd92d2d0348138f50c309e532574e/users/fd9c49374a5b442696dcf1402a2ef231/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.626044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0bd92d2d0348138f50c309e532574e, user_id=fd9c49374a5b442696dcf1402a2ef231, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:40.628869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:40.650942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1208/2447] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:41:40 2022] PUT /identity/v3/projects/0d0bd92d2d0348138f50c309e532574e/users/fd9c49374a5b442696dcf1402a2ef231/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:41:40.662311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065da8-1023-47c2-9e74-c1c78055d62a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:40.662311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065da8-1023-47c2-9e74-c1c78055d62a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:40.662311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7065da8-1023-47c2-9e74-c1c78055d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:40.702464 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c7065da8-1023-47c2-9e74-c1c78055d62a None None] MFA Rules not processed for user `fd9c49374a5b442696dcf1402a2ef231`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:40.704916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c7065da8-1023-47c2-9e74-c1c78055d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:40.815072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1240/2448] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:41:40.992970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:40.994758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:41.009133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:41:41.059540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac207d1-d61c-499a-b874-fb21882b1e30 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:41.063721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a331472a0040d68824a2245bf3e716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:41.064344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:41.064626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:41.064903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:41.073413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:41.074842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:41.083766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1209/2449] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:41:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:41:50.603505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:50.604042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:50.604231 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:50.630889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:41:50.632248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:50.712345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1241/2450] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 16:41:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:41:50.725095 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:41:50.726872 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:41:50.810385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435bdba-d88d-451c-b38a-03e81558b61e service glance] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:41:50.816993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:41:50.818037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:41:50.818398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:41:50.818880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:41:50.830698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:41:50.832377 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:41:50.842096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1210/2451] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:41:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:42:00.686828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=2,keystone:SELECT=64 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:00.838637 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=52 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:03.364366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:42:03.365932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:03.431820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be98a2-e617-44e3-8d86-12cd7bc74fe6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:42:03.435492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379efb25-d6ae-4148-af0b-08949e3dfbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:42:03.436251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379efb25-d6ae-4148-af0b-08949e3dfbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:03.436532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379efb25-d6ae-4148-af0b-08949e3dfbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:03.436801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379efb25-d6ae-4148-af0b-08949e3dfbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:03.438766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-379efb25-d6ae-4148-af0b-08949e3dfbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:03.519912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379efb25-d6ae-4148-af0b-08949e3dfbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:42:03.521422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379efb25-d6ae-4148-af0b-08949e3dfbb2 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:42:03.533297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1242/2452] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:42:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:42:07.432604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:42:07.503261 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa73688-56a1-45ba-9e83-2edb884817a6 service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:42:07.508035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:42:07.508672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:07.508948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:07.509220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] PATH_INFO: `/v3/users/fd9c49374a5b442696dcf1402a2ef231` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:07.510370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9c49374a5b442696dcf1402a2ef231)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:42:07.512340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:42:07.567224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9c49374a5b442696dcf1402a2ef231'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:07.578757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9c49374a5b442696dcf1402a2ef231'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:07.591512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9c49374a5b442696dcf1402a2ef231'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:07.600698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9c49374a5b442696dcf1402a2ef231'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:07.601415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9c49374a5b442696dcf1402a2ef231'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:07.607922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1211/2453] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:42:07 2022] DELETE /identity/v3/users/fd9c49374a5b442696dcf1402a2ef231 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:42:07.612639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:07.613135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:07.613226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:07.635348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:42:07.636601 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:07.700036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1243/2454] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:42:07.710506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:42:07.712033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:07.793245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928d0aa-9e96-4226-8f7e-50d7b410cda3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:42:07.798089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684545a-9fcd-4c18-a59d-d19c63dfc2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:42:07.798698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684545a-9fcd-4c18-a59d-d19c63dfc2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:07.799046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684545a-9fcd-4c18-a59d-d19c63dfc2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:07.799365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684545a-9fcd-4c18-a59d-d19c63dfc2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:07.809308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684545a-9fcd-4c18-a59d-d19c63dfc2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:42:07.810848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684545a-9fcd-4c18-a59d-d19c63dfc2b5 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:42:07.820594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1212/2455] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:42:08.109186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:42:08.111056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:08.124189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a8ad-775c-4b30-99b2-f91fd1d295e3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:42:08.129927 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:42:08.131163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:08.131430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:08.131749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] PATH_INFO: `/v3/projects/0d0bd92d2d0348138f50c309e532574e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:08.132877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0bd92d2d0348138f50c309e532574e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:42:08.135272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:42:08.186389 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:08.189507 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0bd92d2d0348138f50c309e532574e', 'request_id': 'req-a4894b8f-3722-48ea-88d3-afb439de5d91'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:08.196065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0bd92d2d0348138f50c309e532574e', 'request_id': 'req-a4894b8f-3722-48ea-88d3-afb439de5d91'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:08.203067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0bd92d2d0348138f50c309e532574e', 'request_id': 'req-a4894b8f-3722-48ea-88d3-afb439de5d91'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:08.219971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] The token cache is being invalidate because project 0d0bd92d2d0348138f50c309e532574e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:42:08.220296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:08.220980 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a4894b8f-3722-48ea-88d3-afb439de5d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:42:08.222569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1244/2456] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:42:08 2022] DELETE /identity/v3/projects/0d0bd92d2d0348138f50c309e532574e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:42:14.160804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:14.161352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:14.161352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:14.180966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] MFA Rules not processed for user `a2c490a6ee594cb3826332dfa8eeb45a`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:42:14.182172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:14.200433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:14.242491 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1213/2457] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:42:18.215863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:21.443520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2471-5ad2-4f31-a207-311b87253615 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:21.444143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2471-5ad2-4f31-a207-311b87253615 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:21.444143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2471-5ad2-4f31-a207-311b87253615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:21.464636 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-eddf2471-5ad2-4f31-a207-311b87253615 None None] MFA Rules not processed for user `aa5c1b3aaa3f42a190ece5de26a24ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:42:21.465860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-eddf2471-5ad2-4f31-a207-311b87253615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:21.527489 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1245/2458] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:42:24.234669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=15 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:25.345478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:42:25.347014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:25.429278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a300b3-57f6-4300-8fee-2a9c7cca73ca None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:42:25.434778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a6ce7-05d3-4bf1-a03f-e472a5909224 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:42:25.435408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a6ce7-05d3-4bf1-a03f-e472a5909224 service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:25.435804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a6ce7-05d3-4bf1-a03f-e472a5909224 service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:25.436084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a6ce7-05d3-4bf1-a03f-e472a5909224 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:25.437927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-545a6ce7-05d3-4bf1-a03f-e472a5909224 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:25.452499 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a6ce7-05d3-4bf1-a03f-e472a5909224 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:42:25.454577 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a6ce7-05d3-4bf1-a03f-e472a5909224 service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:42:25.466408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1214/2459] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:42:31.520225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=25 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:35.461598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=32 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:42:42.498624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fbe93-9fd6-4f2e-9a81-829976633ad6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:42:42.499264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fbe93-9fd6-4f2e-9a81-829976633ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:42:42.499264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fbe93-9fd6-4f2e-9a81-829976633ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:42:42.519747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7f7fbe93-9fd6-4f2e-9a81-829976633ad6 None None] MFA Rules not processed for user `17fdb3fb9bb04c21ba95096f1bd6e6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:42:42.520981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7f7fbe93-9fd6-4f2e-9a81-829976633ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:42:42.592151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1246/2460] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:42:52.582072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=25 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:28.256761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092a3d-e57e-460a-80bd-67bd0cd808c0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:43:28.257326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092a3d-e57e-460a-80bd-67bd0cd808c0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:43:28.257326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092a3d-e57e-460a-80bd-67bd0cd808c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:43:28.278400 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3b092a3d-e57e-460a-80bd-67bd0cd808c0 None None] MFA Rules not processed for user `a2c490a6ee594cb3826332dfa8eeb45a`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:43:28.279663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3b092a3d-e57e-460a-80bd-67bd0cd808c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:43:28.287332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1215/2461] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:43:37.794970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:43:37.795569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:43:37.795569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:43:37.816657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] MFA Rules not processed for user `aa5c1b3aaa3f42a190ece5de26a24ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:43:37.817808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:43:37.826821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1247/2462] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:43:38.273220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:47.810797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:43:53.132119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441ba8-fdd0-47e0-868b-d7178b03b4da None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:43:53.132613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441ba8-fdd0-47e0-868b-d7178b03b4da None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:43:53.132715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441ba8-fdd0-47e0-868b-d7178b03b4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:43:53.157076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3b441ba8-fdd0-47e0-868b-d7178b03b4da None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:43:53.158327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3b441ba8-fdd0-47e0-868b-d7178b03b4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:43:53.225422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1216/2463] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:43:53.282319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:43:53.283893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:43:53.361040 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb5e9d-7b79-4986-b872-57d579c4d366 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:43:53.366528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:43:53.367145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:43:53.367425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:43:53.367732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:43:53.376941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:43:53.378599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:43:53.387468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1248/2464] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:43:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:44:03.217530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=25 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:03.383827 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=32 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:09.494539 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:09.495064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:09.495064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:09.522502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:09.523769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:09.532452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1217/2465] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:09.544885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:09.560320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccbb83-9701-492c-b0f6-0d9bebd40d53 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:09.569164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:09.569861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:09.570139 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:09.570405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:09.582628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:09.584261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:09.595400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1249/2466] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:44:17.827031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:17.828669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:17.888664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236563eb-0ced-4972-94bd-06b888cec0bc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:17.893114 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe675ae-527b-4ffb-b988-98a478611a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:17.893743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe675ae-527b-4ffb-b988-98a478611a94 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:17.894022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe675ae-527b-4ffb-b988-98a478611a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:17.894326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe675ae-527b-4ffb-b988-98a478611a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:17.896397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6fe675ae-527b-4ffb-b988-98a478611a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:17.973373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe675ae-527b-4ffb-b988-98a478611a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:17.974832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe675ae-527b-4ffb-b988-98a478611a94 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:17.986392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1218/2467] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:18.510062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:18.521459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39697f4-78b2-46c0-a97d-459ad656dfe8 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:18.526794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:18.527385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:18.527659 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:18.527957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:18.530059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:18.545954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:18.547733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:18.561300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1250/2468] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:27.981049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=57 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:28.100288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:28.100849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:28.101279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:28.125845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:28.127131 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:28.134749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1219/2469] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:28.150188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:28.172469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa23c78-1172-43d6-9edd-bca4c8d6abb3 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:28.179248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:28.181027 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:28.181404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:28.181772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:28.196017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:28.197822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:28.226020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1251/2470] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:44:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 16:44:28.991136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:28.992961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:29.056117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f36fb-7931-49ef-abe7-de4d99ac2912 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:29.060217 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6920c-8ce1-409e-b489-9b13a831af64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:29.060524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6920c-8ce1-409e-b489-9b13a831af64 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:29.060801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6920c-8ce1-409e-b489-9b13a831af64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:29.061108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6920c-8ce1-409e-b489-9b13a831af64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:29.063553 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11d6920c-8ce1-409e-b489-9b13a831af64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:29.075602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6920c-8ce1-409e-b489-9b13a831af64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:29.077101 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6920c-8ce1-409e-b489-9b13a831af64 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:29.087109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1220/2471] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:29.088347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:29.090900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:29.105020 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac731b64-b42d-41c0-8849-dab07e7a3f21 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:29.109152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a137b-d498-4e35-b3dd-4b21f8c250e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:29.110452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a137b-d498-4e35-b3dd-4b21f8c250e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:29.110736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a137b-d498-4e35-b3dd-4b21f8c250e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:29.111008 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a137b-d498-4e35-b3dd-4b21f8c250e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:29.122299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a137b-d498-4e35-b3dd-4b21f8c250e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:29.124296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a137b-d498-4e35-b3dd-4b21f8c250e7 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:29.135205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1252/2472] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:44:32.676731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6907-70f5-4fb4-8640-d996aece12b2 None None] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:32.677230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6907-70f5-4fb4-8640-d996aece12b2 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:32.677351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6907-70f5-4fb4-8640-d996aece12b2 None None] PATH_INFO: `/` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:32.678980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1221/2473] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:44:32.685183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97052783-4e19-4cb1-b4c8-63a717890a39 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:32.685645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97052783-4e19-4cb1-b4c8-63a717890a39 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:32.685741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97052783-4e19-4cb1-b4c8-63a717890a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:32.708778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-97052783-4e19-4cb1-b4c8-63a717890a39 None None] MFA Rules not processed for user `2fdb46b5aa2c477d8abce5a1eb9fb68d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:32.710270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-97052783-4e19-4cb1-b4c8-63a717890a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:32.717112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1253/2474] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:32.730286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6907-70f5-4fb4-8640-d996aece12b2 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:32.732144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-312c6907-70f5-4fb4-8640-d996aece12b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:32.745907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6907-70f5-4fb4-8640-d996aece12b2 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:32.749398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617c051-8c9c-4904-9c60-abecd8912400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:32.750866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617c051-8c9c-4904-9c60-abecd8912400 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:32.751151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617c051-8c9c-4904-9c60-abecd8912400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:32.751424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617c051-8c9c-4904-9c60-abecd8912400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:32.758714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617c051-8c9c-4904-9c60-abecd8912400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:32.760183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617c051-8c9c-4904-9c60-abecd8912400 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:32.770193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1222/2475] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:44:32.855695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e7f61-3a64-4a35-b657-63b905685f40 None None] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:32.855979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e7f61-3a64-4a35-b657-63b905685f40 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:32.856251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e7f61-3a64-4a35-b657-63b905685f40 None None] PATH_INFO: `/` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:32.857619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1254/2476] 10.222.0.88 () {54 vars in 921 bytes} [Wed Aug 24 16:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:44:32.863263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc41ad-f1c5-4f85-a92c-0986fc58683b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:32.863544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc41ad-f1c5-4f85-a92c-0986fc58683b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:32.863847 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc41ad-f1c5-4f85-a92c-0986fc58683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:32.886609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e4cc41ad-f1c5-4f85-a92c-0986fc58683b None None] MFA Rules not processed for user `ff19f92d804245ba908c5609bd133ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:32.887846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e4cc41ad-f1c5-4f85-a92c-0986fc58683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:32.903080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1223/2477] 10.222.0.88 () {58 vars in 1018 bytes} [Wed Aug 24 16:44:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:32.914999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e7f61-3a64-4a35-b657-63b905685f40 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:32.928047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e7f61-3a64-4a35-b657-63b905685f40 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:32.932097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:32.932691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:32.932965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:32.933240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:32.943986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:32.945402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:32.956051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1255/2478] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:42.880890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=38 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:42.951406 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=33 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:43.921212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc41ad-f1c5-4f85-a92c-0986fc58683b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:43.931473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc41ad-f1c5-4f85-a92c-0986fc58683b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:43.935996 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:43.936698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:43.937043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:43.937386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:43.939424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:44.015792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:44.017243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:44.027545 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1224/2479] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:48.717369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:48.719302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:48.736426 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387f76-b3d9-49af-b052-d1aff5a78925 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:48.743476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:48.746274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:48.747002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:48.747616 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:48.751417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:48.765459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:48.767333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:48.779998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1256/2480] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:48.805299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:48.806822 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:48.822646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065b7a4-028f-40d5-9a04-f67563bdb70b service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:48.830312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:48.831332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:48.831743 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:48.832249 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] PATH_INFO: `/v3/users/aa5c1b3aaa3f42a190ece5de26a24ca6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:48.833618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5c1b3aaa3f42a190ece5de26a24ca6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:48.835860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:48.891806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:48.893606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:48.893749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5c1b3aaa3f42a190ece5de26a24ca6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.901667 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5c1b3aaa3f42a190ece5de26a24ca6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.911048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7ee7d-22d5-4f6d-97d4-557a5c98099f service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:48.915847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:48.916480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:48.916752 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:48.917028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] PATH_INFO: `/v3/users/a2c490a6ee594cb3826332dfa8eeb45a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:48.918187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c490a6ee594cb3826332dfa8eeb45a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:48.918327 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5c1b3aaa3f42a190ece5de26a24ca6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.920361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:48.927175 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5c1b3aaa3f42a190ece5de26a24ca6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.927841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5c1b3aaa3f42a190ece5de26a24ca6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.934152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1225/2481] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:44:48 2022] DELETE /identity/v3/users/aa5c1b3aaa3f42a190ece5de26a24ca6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:48.968655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c490a6ee594cb3826332dfa8eeb45a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.969415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c490a6ee594cb3826332dfa8eeb45a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.976317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c490a6ee594cb3826332dfa8eeb45a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.977115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c490a6ee594cb3826332dfa8eeb45a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:48.988717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c490a6ee594cb3826332dfa8eeb45a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.007945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1257/2482] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:44:48 2022] DELETE /identity/v3/users/a2c490a6ee594cb3826332dfa8eeb45a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:49.118151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.119973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.195077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.196576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.203012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904848a-f5cc-45b5-ac25-7103fa44f6e5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.221322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:49.272217 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133761c8-81a1-42bb-a8cf-ca1e94bd04a4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.273638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.274316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.274593 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.274892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] PATH_INFO: `/v3/projects/bf32de17f9d14842a78689bc20f3c15c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.276064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf32de17f9d14842a78689bc20f3c15c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.277010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.277642 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.277921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.278146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.278272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] PATH_INFO: `/v3/projects/af89fd01e26943eeb101cfeaeca5bd38` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.279317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af89fd01e26943eeb101cfeaeca5bd38)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.281286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.330515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf32de17f9d14842a78689bc20f3c15c', 'request_id': 'req-0a97b1c7-c72e-4114-aff9-d5660afdc25c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.338733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af89fd01e26943eeb101cfeaeca5bd38', 'request_id': 'req-7d715d87-c311-44da-be04-9071a14f768a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.340142 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf32de17f9d14842a78689bc20f3c15c', 'request_id': 'req-0a97b1c7-c72e-4114-aff9-d5660afdc25c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.346088 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af89fd01e26943eeb101cfeaeca5bd38', 'request_id': 'req-7d715d87-c311-44da-be04-9071a14f768a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.347192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf32de17f9d14842a78689bc20f3c15c', 'request_id': 'req-0a97b1c7-c72e-4114-aff9-d5660afdc25c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.349202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:49.354231 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af89fd01e26943eeb101cfeaeca5bd38', 'request_id': 'req-7d715d87-c311-44da-be04-9071a14f768a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.360598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] The token cache is being invalidate because project bf32de17f9d14842a78689bc20f3c15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:44:49.360880 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.361549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0a97b1c7-c72e-4114-aff9-d5660afdc25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.363105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1226/2483] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:44:49 2022] DELETE /identity/v3/projects/bf32de17f9d14842a78689bc20f3c15c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:49.368184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b978d-569a-41f3-ad07-792296f3ea5a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.368468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b978d-569a-41f3-ad07-792296f3ea5a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.368741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b978d-569a-41f3-ad07-792296f3ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.368937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] The token cache is being invalidate because project af89fd01e26943eeb101cfeaeca5bd38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:44:49.369249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.369872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7d715d87-c311-44da-be04-9071a14f768a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:49.371472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1258/2484] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:44:49 2022] DELETE /identity/v3/projects/af89fd01e26943eeb101cfeaeca5bd38 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:44:49.376236 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1ce4c-e50c-43c5-b198-c46520dd8cad None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.376523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1ce4c-e50c-43c5-b198-c46520dd8cad None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.376837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1ce4c-e50c-43c5-b198-c46520dd8cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.389210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f42b978d-569a-41f3-ad07-792296f3ea5a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:49.390477 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f42b978d-569a-41f3-ad07-792296f3ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.396804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d9e1ce4c-e50c-43c5-b198-c46520dd8cad None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:49.398007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d9e1ce4c-e50c-43c5-b198-c46520dd8cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.461244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1227/2485] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:49.468003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1259/2486] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:49.473433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28350-226e-4937-95c9-87fa391017cc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.473902 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28350-226e-4937-95c9-87fa391017cc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.474317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28350-226e-4937-95c9-87fa391017cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.477548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6ce4-0d54-4c43-b931-af0c88f4290c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.477836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6ce4-0d54-4c43-b931-af0c88f4290c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.478106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a6ce4-0d54-4c43-b931-af0c88f4290c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.499721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-80a28350-226e-4937-95c9-87fa391017cc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:49.500778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-748a6ce4-0d54-4c43-b931-af0c88f4290c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:49.501293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-80a28350-226e-4937-95c9-87fa391017cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.502155 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-748a6ce4-0d54-4c43-b931-af0c88f4290c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.509885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1228/2487] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:49.510684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1260/2488] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:49.513936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a28350-226e-4937-95c9-87fa391017cc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.514566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6ce4-0d54-4c43-b931-af0c88f4290c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.524950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a6ce4-0d54-4c43-b931-af0c88f4290c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.525172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a28350-226e-4937-95c9-87fa391017cc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.529831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.530144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.530424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.530696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.530813 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.530961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.531080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.531269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.531838 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:44:49.532119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:44:49.532478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.532599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.533771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.534143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.547626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1261/2489] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:44:49.547829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1229/2490] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:44:49.550382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.551364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.561574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1bba5-c08a-498d-b79d-27b40a7565f5 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.561950 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c397f3-b6f6-4ea7-9d7d-e0344c9283a4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.567324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.567946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.568289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.568512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.569092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.569218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.569695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.570009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.570233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.570850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.571013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.572795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.601223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1230/2491] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:49.605431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.606167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1262/2492] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:49.610357 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:49.610829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.677296 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537720-b096-4f19-829e-51c06af131dd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.681000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d812c83-3fe8-461e-a8c7-5d56073a2ff6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.682239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.682850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.683125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.683397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.684060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.685855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.685997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.686470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.686749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.687024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.687712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.689865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.709611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1231/2493] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:49.713466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.718162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1263/2494] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:49.719424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.724204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680c722-fc69-4b88-a8e9-fec61f0bd536 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.729164 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.729771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.730048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.730402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.730674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead93667-7d8c-47e5-a706-8ee28932a508 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.731054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.732706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.735869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.736567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.736848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.737124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.737770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.739505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.747086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1232/2495] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:49.751238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.753746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1264/2496] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:49.757577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.764470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8906e7-2030-4621-8932-ed90a25e61ba admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.768731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e4c08-55d7-4d66-98e2-f9d6ce27755d admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.770415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.771022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.771304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.771600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.772258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.773897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.774062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.774789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.775169 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.775550 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.776451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.778203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.786268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1233/2497] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:44:49.791404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1265/2498] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:44:49.792254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.795806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.806905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd914033-be21-4348-b5b8-013ffff2faa0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.810637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a810b1-d507-45b6-9e80-27fd4261f132 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:49.812621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e904e4-8b01-4a9e-9737-236e3f685bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.813344 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e904e4-8b01-4a9e-9737-236e3f685bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.813639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e904e4-8b01-4a9e-9737-236e3f685bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.813904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e904e4-8b01-4a9e-9737-236e3f685bb5 admin admin] PATH_INFO: `/v3/projects/d0d1158724e34678b9317a931e30eb71/users/14696fd75489402fad7fea1eab399b49/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.816017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7a3f3-0347-4539-ad3d-e41d8a193bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:49.816677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a3f3-0347-4539-ad3d-e41d8a193bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.816986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a3f3-0347-4539-ad3d-e41d8a193bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.817257 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a3f3-0347-4539-ad3d-e41d8a193bba admin admin] PATH_INFO: `/v3/projects/63e5d8dc6b8b4b9d99b893c89105217a/users/68da179761e64385adaee3a30c1d372d/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.829498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e904e4-8b01-4a9e-9737-236e3f685bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d1158724e34678b9317a931e30eb71, user_id=14696fd75489402fad7fea1eab399b49, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.829759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:49.832198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e904e4-8b01-4a9e-9737-236e3f685bb5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.832887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7a3f3-0347-4539-ad3d-e41d8a193bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e5d8dc6b8b4b9d99b893c89105217a, user_id=68da179761e64385adaee3a30c1d372d, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:49.835925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7a3f3-0347-4539-ad3d-e41d8a193bba admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:49.846449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1234/2499] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:49 2022] PUT /identity/v3/projects/d0d1158724e34678b9317a931e30eb71/users/14696fd75489402fad7fea1eab399b49/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:49.850941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1266/2500] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:49 2022] PUT /identity/v3/projects/63e5d8dc6b8b4b9d99b893c89105217a/users/68da179761e64385adaee3a30c1d372d/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:49.856607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0c1aa-bc02-4cfa-9bc7-2591e55b2f32 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.856899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0c1aa-bc02-4cfa-9bc7-2591e55b2f32 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.857171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0c1aa-bc02-4cfa-9bc7-2591e55b2f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.861969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:49.862476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:49.862879 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:49.889274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a0f0c1aa-bc02-4cfa-9bc7-2591e55b2f32 None None] MFA Rules not processed for user `14696fd75489402fad7fea1eab399b49`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:49.890798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a0f0c1aa-bc02-4cfa-9bc7-2591e55b2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.896895 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] MFA Rules not processed for user `68da179761e64385adaee3a30c1d372d`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:49.898076 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:49.958732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1235/2501] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:49.965394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1267/2502] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:49.969650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0c1aa-bc02-4cfa-9bc7-2591e55b2f32 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.971006 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:49.972674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:50.007965 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:50.034889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0c1aa-bc02-4cfa-9bc7-2591e55b2f32 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.039456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.040096 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.040372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.040643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.041274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.043202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.047482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6b66f-1ca5-48ae-9a0e-b67d2578a6dc None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.053243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.053854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.054135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.054409 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.062888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.065114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.071912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1236/2503] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:49 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:50.074354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1268/2504] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:50.076199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:50.137353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f691297-056e-4595-b064-f1dec8935511 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.142533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.143449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.143773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.144058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.144702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.146648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.170854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1237/2505] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:50 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:50.175153 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:50.186587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47aac5-1fc1-4c07-b51e-ee6db2706589 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.192926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.193595 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.193877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.194145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.194835 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.196618 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.207995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1269/2506] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:50.212714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:50.224211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7566e4f-80a4-4a3a-a2be-45b1abd1d5e6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.230392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.231162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.231474 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.231860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] PATH_INFO: `/v3/projects/da430e6bdc144a3b9a645fed59018fa4/users/c5eedaacf49c49e6b2500d34affad7bc/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.249531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da430e6bdc144a3b9a645fed59018fa4, user_id=c5eedaacf49c49e6b2500d34affad7bc, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.252972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.267920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1238/2507] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:50 2022] PUT /identity/v3/projects/da430e6bdc144a3b9a645fed59018fa4/users/c5eedaacf49c49e6b2500d34affad7bc/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:50.272034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:50.283317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7684ec-cd63-4932-b5d0-a93722bb805b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.348168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:50.364525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805c6fa-c218-4049-a2dd-cc6eb1f54c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.365411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c6fa-c218-4049-a2dd-cc6eb1f54c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.365865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c6fa-c218-4049-a2dd-cc6eb1f54c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.366288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805c6fa-c218-4049-a2dd-cc6eb1f54c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.367085 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c6fa-c218-4049-a2dd-cc6eb1f54c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.368965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805c6fa-c218-4049-a2dd-cc6eb1f54c54 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.383572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1270/2508] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:44:50.384756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:50.399730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df66e-0d9d-442c-b5a5-381606ae00e6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.405141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.405864 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.406155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.406440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] PATH_INFO: `/v3/projects/da430e6bdc144a3b9a645fed59018fa4/users/c5eedaacf49c49e6b2500d34affad7bc/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.408716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da430e6bdc144a3b9a645fed59018fa4, user_id=c5eedaacf49c49e6b2500d34affad7bc, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.411518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.425365 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1239/2509] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:50 2022] PUT /identity/v3/projects/da430e6bdc144a3b9a645fed59018fa4/users/c5eedaacf49c49e6b2500d34affad7bc/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:44:50.436056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a012-5118-4abe-bc34-653c678e68b1 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.436478 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a012-5118-4abe-bc34-653c678e68b1 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.436760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a012-5118-4abe-bc34-653c678e68b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.470497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-7271a012-5118-4abe-bc34-653c678e68b1 None None] MFA Rules not processed for user `c5eedaacf49c49e6b2500d34affad7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:50.471379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7271a012-5118-4abe-bc34-653c678e68b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:50.544733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1271/2510] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:50.556629 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:50.558509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:50.620871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ef5ab-bd89-4ccc-86fe-d2281f8ab968 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.624898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.626004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.626143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.626405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.635865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.637343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.648458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1240/2511] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:50.732259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271a012-5118-4abe-bc34-653c678e68b1 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:50.743244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271a012-5118-4abe-bc34-653c678e68b1 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:50.747486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db847c-6723-470d-84b9-57ce83b4103c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:50.748157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db847c-6723-470d-84b9-57ce83b4103c service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:50.748442 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db847c-6723-470d-84b9-57ce83b4103c service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:50.748720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db847c-6723-470d-84b9-57ce83b4103c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:50.818868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db847c-6723-470d-84b9-57ce83b4103c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:50.820377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db847c-6723-470d-84b9-57ce83b4103c service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:50.829545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1272/2512] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:53.651907 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:53.669704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:53.721244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94e60-90b4-472d-a890-4a98e83ffac8 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:53.726651 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:53.727302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:53.727658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:53.727866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] PATH_INFO: `/v3/users/68da179761e64385adaee3a30c1d372d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:53.729129 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68da179761e64385adaee3a30c1d372d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:53.731083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:53.791083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68da179761e64385adaee3a30c1d372d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:53.798598 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68da179761e64385adaee3a30c1d372d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:53.811048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68da179761e64385adaee3a30c1d372d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:53.821037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68da179761e64385adaee3a30c1d372d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:53.821664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68da179761e64385adaee3a30c1d372d'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:53.827921 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1241/2513] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:44:53 2022] DELETE /identity/v3/users/68da179761e64385adaee3a30c1d372d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:53.832884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:53.833369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:53.833485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:53.853684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:53.854924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:53.931089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1273/2514] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:53.942865 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:53.944614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:54.011781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e81496-fd3f-4722-a475-326a80a8c253 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:54.016209 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:54.016838 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:54.017120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:54.017392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:54.028075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:54.029476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:54.040009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1242/2515] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:54.335477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:54.337012 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:54.352569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bf086-cdb1-44db-8082-af596e0a8f80 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:54.365828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:54.366540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:54.366809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:54.367143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] PATH_INFO: `/v3/projects/63e5d8dc6b8b4b9d99b893c89105217a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:54.368760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e5d8dc6b8b4b9d99b893c89105217a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:54.370780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:54.383066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:54.422149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e5d8dc6b8b4b9d99b893c89105217a', 'request_id': 'req-95ba6897-e5b0-4503-8985-338b578db190'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.427746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e5d8dc6b8b4b9d99b893c89105217a', 'request_id': 'req-95ba6897-e5b0-4503-8985-338b578db190'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.434305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e5d8dc6b8b4b9d99b893c89105217a', 'request_id': 'req-95ba6897-e5b0-4503-8985-338b578db190'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.448204 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] The token cache is being invalidate because project 63e5d8dc6b8b4b9d99b893c89105217a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:44:54.448537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.449175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.450669 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1274/2516] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:44:54 2022] DELETE /identity/v3/projects/63e5d8dc6b8b4b9d99b893c89105217a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:54.455000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:54.465502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91677-6791-4442-81b8-f5b7746fba62 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:54.502049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:54.527511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:54.528196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:54.528479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:54.528756 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] PATH_INFO: `/v3/users/c5eedaacf49c49e6b2500d34affad7bc` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:54.529928 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5eedaacf49c49e6b2500d34affad7bc)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:54.531896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:54.591061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5eedaacf49c49e6b2500d34affad7bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.600603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5eedaacf49c49e6b2500d34affad7bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.615446 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5eedaacf49c49e6b2500d34affad7bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.624497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5eedaacf49c49e6b2500d34affad7bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.625155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-25ce4c60-c521-4498-a498-a016ac29b89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5eedaacf49c49e6b2500d34affad7bc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:54.632800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1243/2517] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:44:54 2022] DELETE /identity/v3/users/c5eedaacf49c49e6b2500d34affad7bc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:54.931563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:54.933148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:54.946614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba6897-e5b0-4503-8985-338b578db190 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.012245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.012878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.013161 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.013436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] PATH_INFO: `/v3/projects/da430e6bdc144a3b9a645fed59018fa4` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.014640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da430e6bdc144a3b9a645fed59018fa4)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.016652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.067146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da430e6bdc144a3b9a645fed59018fa4', 'request_id': 'req-6a01d346-49f1-44b0-b960-24ae0c69d8e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.072538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da430e6bdc144a3b9a645fed59018fa4', 'request_id': 'req-6a01d346-49f1-44b0-b960-24ae0c69d8e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.078540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da430e6bdc144a3b9a645fed59018fa4', 'request_id': 'req-6a01d346-49f1-44b0-b960-24ae0c69d8e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.093351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] The token cache is being invalidate because project da430e6bdc144a3b9a645fed59018fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:44:55.093649 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.094260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6a01d346-49f1-44b0-b960-24ae0c69d8e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.095854 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1275/2518] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:44:54 2022] DELETE /identity/v3/projects/da430e6bdc144a3b9a645fed59018fa4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:55.101057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2937-a26a-4a2a-9092-3f4e6c9d151f None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.101532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2937-a26a-4a2a-9092-3f4e6c9d151f None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.101532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c2937-a26a-4a2a-9092-3f4e6c9d151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.122218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0f6c2937-a26a-4a2a-9092-3f4e6c9d151f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:55.123470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0f6c2937-a26a-4a2a-9092-3f4e6c9d151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:55.185256 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1244/2519] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:55.194767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce6a9-e94d-4d39-a445-a880ce296fb8 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.195052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce6a9-e94d-4d39-a445-a880ce296fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.195331 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce6a9-e94d-4d39-a445-a880ce296fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.222411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-47bce6a9-e94d-4d39-a445-a880ce296fb8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:55.223891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-47bce6a9-e94d-4d39-a445-a880ce296fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:55.232567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1276/2520] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:55.236827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c2937-a26a-4a2a-9092-3f4e6c9d151f None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.247226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c2937-a26a-4a2a-9092-3f4e6c9d151f None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.252364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.252867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.253317 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.253657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.254355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:44:55.254607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.256279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.270036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1245/2521] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:44:55.274776 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bce6a9-e94d-4d39-a445-a880ce296fb8 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.285472 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bce6a9-e94d-4d39-a445-a880ce296fb8 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.290747 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.291470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.291680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.292016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.292598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.294597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.325917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:55.337030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1277/2522] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:55.337852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.349070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fc79a-9fab-4624-b1ca-78211001e0f3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.361475 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.363889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:55.402393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:55.419989 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.420600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.420883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.421151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.421788 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.423784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.429539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c072f-1c87-4925-83a8-f1f572947080 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.434381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.435044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.435317 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.435603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] PATH_INFO: `/v3/users/14696fd75489402fad7fea1eab399b49` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.436741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14696fd75489402fad7fea1eab399b49)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.438804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.450725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1246/2523] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:55.452362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.462697 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3ffc-c803-492a-9f99-37daa76b63bc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.467785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.468444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.468718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.469012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.469664 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.471267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.484165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1247/2524] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:55.488334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.493118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14696fd75489402fad7fea1eab399b49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.493996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14696fd75489402fad7fea1eab399b49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.498160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55a86b-ca9d-422f-82f9-e759a63291cb admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.501061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14696fd75489402fad7fea1eab399b49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.501729 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14696fd75489402fad7fea1eab399b49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.503070 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.503622 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.503953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.504224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.504860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.506653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.510533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-4f15fc19-b540-49e1-8886-72370546941b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14696fd75489402fad7fea1eab399b49'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:55.517240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1248/2525] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:44:55.521991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.523779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:55.532045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1278/2526] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:44:55 2022] DELETE /identity/v3/users/14696fd75489402fad7fea1eab399b49 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:55.536423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.536712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a3bd1-80aa-444a-b0e4-e2282a932b10 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.536853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.536963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.555388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:55.556621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:55.594848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b702b-c935-45a6-aa93-3469d4ce5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.595511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b702b-c935-45a6-aa93-3469d4ce5e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.595821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b702b-c935-45a6-aa93-3469d4ce5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.596094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b702b-c935-45a6-aa93-3469d4ce5e89 admin admin] PATH_INFO: `/v3/projects/3e44742311c44ed196b22ba354d9a958/users/047de9f722584df0a79d0f1290d7c237/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.611413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b702b-c935-45a6-aa93-3469d4ce5e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e44742311c44ed196b22ba354d9a958, user_id=047de9f722584df0a79d0f1290d7c237, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.614236 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b702b-c935-45a6-aa93-3469d4ce5e89 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.617196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1279/2527] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:55.627543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.628924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1249/2528] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:55 2022] PUT /identity/v3/projects/3e44742311c44ed196b22ba354d9a958/users/047de9f722584df0a79d0f1290d7c237/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:44:55.632558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:55.639407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5396-3af9-4933-b7fa-05b2510784a6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.639967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5396-3af9-4933-b7fa-05b2510784a6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.640231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c5396-3af9-4933-b7fa-05b2510784a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.657084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:55.671260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-a73c5396-3af9-4933-b7fa-05b2510784a6 None None] MFA Rules not processed for user `047de9f722584df0a79d0f1290d7c237`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:55.672571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-a73c5396-3af9-4933-b7fa-05b2510784a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:55.694660 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093a2aa-54e8-44a4-b7ac-b264fc64f980 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.740378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1250/2529] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:55.744791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c5396-3af9-4933-b7fa-05b2510784a6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.761561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.762199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.762470 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.762746 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.773002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:55.817354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c5396-3af9-4933-b7fa-05b2510784a6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.822276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.822892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.823247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.823471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.824132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.826084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.830121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.831620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.841955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1280/2530] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:55.855488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1251/2531] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:55.859939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.870577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71134b-f2ca-4b9e-86e0-b6ee051f9d8b service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.933391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.934154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.934274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.934535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.935165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.938025 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:55.966808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1281/2532] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:55 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:55.968591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:55.980334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5b246-cd0f-432e-acef-3ce586f7398f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:55.985795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:55.986522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:55.986805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:55.987122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:55.988086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:55.989878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.001631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1252/2533] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:56.005830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.016809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3b27e-af9b-49d8-b9de-caab863d8b7c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.022850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fc8c5-54be-4061-814d-c16e5f2d1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.023538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fc8c5-54be-4061-814d-c16e5f2d1b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.023850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fc8c5-54be-4061-814d-c16e5f2d1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.024122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fc8c5-54be-4061-814d-c16e5f2d1b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.024771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fc8c5-54be-4061-814d-c16e5f2d1b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.026530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fc8c5-54be-4061-814d-c16e5f2d1b34 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.037740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1282/2534] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:56.041849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.053090 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35761f08-d365-4b97-a300-3560d3c3db35 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.057799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.058454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.058728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.058998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] PATH_INFO: `/v3/projects/3ab3ef0f92474380b74b5d33c0141af9/users/90fd22d5525e42e7bd1b3977b1c44d1e/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.074064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab3ef0f92474380b74b5d33c0141af9, user_id=90fd22d5525e42e7bd1b3977b1c44d1e, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.076758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.090770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1253/2535] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:56 2022] PUT /identity/v3/projects/3ab3ef0f92474380b74b5d33c0141af9/users/90fd22d5525e42e7bd1b3977b1c44d1e/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:56.102445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c43f-be31-4826-917f-3c72666bfc7b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.102706 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c43f-be31-4826-917f-3c72666bfc7b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.103016 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c43f-be31-4826-917f-3c72666bfc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.111638 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:56.126178 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.128496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.138010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fff8c43f-be31-4826-917f-3c72666bfc7b None None] MFA Rules not processed for user `90fd22d5525e42e7bd1b3977b1c44d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:56.139448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fff8c43f-be31-4826-917f-3c72666bfc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.202523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797e845-e11e-4e98-ba66-5061325f8af6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.207687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.208324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.208603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.208873 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] PATH_INFO: `/v3/projects/d0d1158724e34678b9317a931e30eb71` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.209991 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d1158724e34678b9317a931e30eb71)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.210972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1283/2536] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:56.212079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.216513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c43f-be31-4826-917f-3c72666bfc7b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.227614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c43f-be31-4826-917f-3c72666bfc7b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.232462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.233056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.233333 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.233661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.234289 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.236241 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.262291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d1158724e34678b9317a931e30eb71', 'request_id': 'req-f258ac41-4058-4810-866b-3515d99248e1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:56.270072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1284/2537] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:56.271229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.274429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d1158724e34678b9317a931e30eb71', 'request_id': 'req-f258ac41-4058-4810-866b-3515d99248e1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:56.281248 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d1158724e34678b9317a931e30eb71', 'request_id': 'req-f258ac41-4058-4810-866b-3515d99248e1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:56.293936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] The token cache is being invalidate because project d0d1158724e34678b9317a931e30eb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:44:56.294231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:56.294925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f258ac41-4058-4810-866b-3515d99248e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:56.296689 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1254/2538] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:44:56 2022] DELETE /identity/v3/projects/d0d1158724e34678b9317a931e30eb71 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:44:56.301827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecce7-8a8e-4c10-99bd-9af424604bda None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.302108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecce7-8a8e-4c10-99bd-9af424604bda None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.302385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ecce7-8a8e-4c10-99bd-9af424604bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.311635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:56.328430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-5c3ecce7-8a8e-4c10-99bd-9af424604bda None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:56.329671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5c3ecce7-8a8e-4c10-99bd-9af424604bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.346840 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960eac7-b189-4cf3-870a-20fe26ed04d7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.351920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.352534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.352820 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.353093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.353722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.355726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.380346 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1285/2539] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:56.384418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.386158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.395369 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1255/2540] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:56.403709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3421009-5273-485a-bdde-846782754ee7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.405207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa888-0f9b-4949-8091-7657f98b45a4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.405496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa888-0f9b-4949-8091-7657f98b45a4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.405769 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa888-0f9b-4949-8091-7657f98b45a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.409065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.409766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.410295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.410295 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.410954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.412586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.423278 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1286/2541] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:56.426937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4a1fa888-0f9b-4949-8091-7657f98b45a4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:56.428001 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.428204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4a1fa888-0f9b-4949-8091-7657f98b45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.437481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1256/2542] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:56.438458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177080f-ebfb-4bf0-976d-ed01ec4eb71f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.441846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa888-0f9b-4949-8091-7657f98b45a4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.444392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.445056 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.445340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.445682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] PATH_INFO: `/v3/projects/e5a453444579464483098b762664413d/users/e1881d99eb004a768a11f89512eeea8e/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.451280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa888-0f9b-4949-8091-7657f98b45a4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.456215 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.457029 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.457278 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.457556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.458206 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:44:56.458515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.460162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.463014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a453444579464483098b762664413d, user_id=e1881d99eb004a768a11f89512eeea8e, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.465955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.472945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1257/2543] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:44:56.477559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.480745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1287/2544] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:56 2022] PUT /identity/v3/projects/e5a453444579464483098b762664413d/users/e1881d99eb004a768a11f89512eeea8e/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:44:56.484575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.489197 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d75ba9-d913-4b80-afe6-0d169520c34b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.517233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:56.548585 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.549210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.549493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.549867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.551022 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.553019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.556458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1c455-6c43-4a2c-90b9-77bc8dad9bd0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.561367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.561975 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.562249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.562519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.563152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.564779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.575890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1288/2545] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:44:56.580141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.589575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1258/2546] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:56.590597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.590806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09622af9-17fb-49ad-ab13-c0f90813d6df admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.647894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc392426-fa7a-424b-96b0-11d6ba48051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.648471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392426-fa7a-424b-96b0-11d6ba48051f admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.648751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392426-fa7a-424b-96b0-11d6ba48051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.649026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc392426-fa7a-424b-96b0-11d6ba48051f admin admin] PATH_INFO: `/v3/projects/e5a453444579464483098b762664413d/users/e1881d99eb004a768a11f89512eeea8e/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.650952 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc392426-fa7a-424b-96b0-11d6ba48051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a453444579464483098b762664413d, user_id=e1881d99eb004a768a11f89512eeea8e, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.653863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc392426-fa7a-424b-96b0-11d6ba48051f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.655843 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fef81-a8d5-42e0-b155-fa9bb18895a1 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.660934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.661552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.661834 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.662116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.662878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.664835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.665234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1289/2547] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:56 2022] PUT /identity/v3/projects/e5a453444579464483098b762664413d/users/e1881d99eb004a768a11f89512eeea8e/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:56.675821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a5811-9300-46ca-b914-39767615a805 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.676064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a5811-9300-46ca-b914-39767615a805 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.676247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a5811-9300-46ca-b914-39767615a805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.687009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:56.695611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1259/2548] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:56.697173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.707144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fc7a5811-9300-46ca-b914-39767615a805 None None] MFA Rules not processed for user `e1881d99eb004a768a11f89512eeea8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:56.707313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6b140-4475-43a1-a923-a28c93de0677 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.708482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fc7a5811-9300-46ca-b914-39767615a805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.766792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.767483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.768202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.768471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.769258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.770854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.779280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1290/2549] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:56.781234 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1260/2550] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:44:56.785301 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a5811-9300-46ca-b914-39767615a805 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.790383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.792325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.795964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a5811-9300-46ca-b914-39767615a805 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.801194 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.801813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.802092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.802493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.803151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.804874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.815612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1291/2551] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:56.820680 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:56.832588 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7c59a-8f7c-4d28-9278-045b95d7074a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.837807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44c6da-06b0-4f55-ab7b-e9253238cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.838449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44c6da-06b0-4f55-ab7b-e9253238cf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.838737 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44c6da-06b0-4f55-ab7b-e9253238cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.839011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44c6da-06b0-4f55-ab7b-e9253238cf82 admin admin] PATH_INFO: `/v3/projects/0626d20292b141cdb1ab012e978e6bed/users/de99e0a1c6ea4137babc9f07716b4858/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.854421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cb5e3-6f9f-47d2-a057-2b223508c54f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:56.854800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44c6da-06b0-4f55-ab7b-e9253238cf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0626d20292b141cdb1ab012e978e6bed, user_id=de99e0a1c6ea4137babc9f07716b4858, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.857513 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44c6da-06b0-4f55-ab7b-e9253238cf82 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.858455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:56.859071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.859349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.859643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.869571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:56.871148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:56.871942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1292/2552] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:56 2022] PUT /identity/v3/projects/0626d20292b141cdb1ab012e978e6bed/users/de99e0a1c6ea4137babc9f07716b4858/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:44:56.881233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1261/2553] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:56.884431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5e1b-c302-4e17-be81-e1db253e6e9c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:56.884591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5e1b-c302-4e17-be81-e1db253e6e9c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:56.884822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5e1b-c302-4e17-be81-e1db253e6e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:56.902229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:56.918845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-53ff5e1b-c302-4e17-be81-e1db253e6e9c None None] MFA Rules not processed for user `de99e0a1c6ea4137babc9f07716b4858`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:56.920221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-53ff5e1b-c302-4e17-be81-e1db253e6e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:56.995762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1293/2554] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:57.000889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.012949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85675dc-7f22-4263-9048-75074b6928d2 service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.072286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.072981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.073267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.073556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.074177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.076136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.109055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1262/2555] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:56 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:57.113244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5e1b-c302-4e17-be81-e1db253e6e9c None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.125151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5e1b-c302-4e17-be81-e1db253e6e9c None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.185920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.186533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.186808 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.187074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.187751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.189705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.212822 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1294/2556] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:57 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:57.216903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.227258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017ef41-6b2a-4e29-b3bc-8850bf8536ea admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.232338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.232946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.233262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.233538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.234213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.235854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.246715 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1263/2557] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:57.251265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.266113 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b1606-b8cf-492e-bce8-619dbe0ff6e8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.272925 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.273604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.273889 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.274372 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] PATH_INFO: `/v3/projects/9f0f486f677a4d54befc4666d04b9bf3/users/3813af02f6f9443882607513d3aaf73a/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.293266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0f486f677a4d54befc4666d04b9bf3, user_id=3813af02f6f9443882607513d3aaf73a, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.296050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.322714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1295/2558] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:57 2022] PUT /identity/v3/projects/9f0f486f677a4d54befc4666d04b9bf3/users/3813af02f6f9443882607513d3aaf73a/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:44:57.326924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.337779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5abde-8bce-4cde-8bf7-a095fb53f63a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.346920 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:57.402326 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.402942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.403222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.403496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.404170 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.410479 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.416567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1264/2559] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:44:57.420662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.423784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.425690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:57.431899 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d1223-df49-46c4-a045-fc9c186b2587 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.436964 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847740b7-38c6-4f8f-ab25-8499f915e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.437624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847740b7-38c6-4f8f-ab25-8499f915e31d admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.437900 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847740b7-38c6-4f8f-ab25-8499f915e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.438176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847740b7-38c6-4f8f-ab25-8499f915e31d admin admin] PATH_INFO: `/v3/projects/9f0f486f677a4d54befc4666d04b9bf3/users/3813af02f6f9443882607513d3aaf73a/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.440587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847740b7-38c6-4f8f-ab25-8499f915e31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0f486f677a4d54befc4666d04b9bf3, user_id=3813af02f6f9443882607513d3aaf73a, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.448425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847740b7-38c6-4f8f-ab25-8499f915e31d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.459802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1296/2560] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:57 2022] PUT /identity/v3/projects/9f0f486f677a4d54befc4666d04b9bf3/users/3813af02f6f9443882607513d3aaf73a/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:57.469985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9b42-967b-4f89-bbe1-86ad5eae3e49 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.470266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9b42-967b-4f89-bbe1-86ad5eae3e49 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.470558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9b42-967b-4f89-bbe1-86ad5eae3e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.486394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75942a7a-ad53-4679-a53e-979b5deddf44 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.498493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cabb9b42-967b-4f89-bbe1-86ad5eae3e49 None None] MFA Rules not processed for user `3813af02f6f9443882607513d3aaf73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:57.499750 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cabb9b42-967b-4f89-bbe1-86ad5eae3e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:57.537978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1f3ca-7b97-49df-b2f9-75dd366d0915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.538602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f3ca-7b97-49df-b2f9-75dd366d0915 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.538885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f3ca-7b97-49df-b2f9-75dd366d0915 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.539159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1f3ca-7b97-49df-b2f9-75dd366d0915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.539682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:57.541225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dae1f3ca-7b97-49df-b2f9-75dd366d0915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:57.573175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1297/2561] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:57.585637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb9b42-967b-4f89-bbe1-86ad5eae3e49 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:57.596105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb9b42-967b-4f89-bbe1-86ad5eae3e49 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:57.600677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:57.601328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:57.601609 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:57.601876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:57.612250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.613569 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f3ca-7b97-49df-b2f9-75dd366d0915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:57.613709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.615073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1f3ca-7b97-49df-b2f9-75dd366d0915 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:57.623596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1298/2562] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:44:57.624427 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1265/2563] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:58.072797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:58.139751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3395c-f171-4746-b8dd-3e06691a78e5 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:58.145182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:58.145804 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:58.146069 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:58.146338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] PATH_INFO: `/v3/users/de99e0a1c6ea4137babc9f07716b4858` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:58.147479 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de99e0a1c6ea4137babc9f07716b4858)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:58.149468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:58.202645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de99e0a1c6ea4137babc9f07716b4858'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.203329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de99e0a1c6ea4137babc9f07716b4858'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.211131 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de99e0a1c6ea4137babc9f07716b4858'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.211797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de99e0a1c6ea4137babc9f07716b4858'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.220703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de99e0a1c6ea4137babc9f07716b4858'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.246386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1299/2564] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:44:58 2022] DELETE /identity/v3/users/de99e0a1c6ea4137babc9f07716b4858 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:58.252449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:58.252959 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:58.253198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:58.273333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:58.274549 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:58.287253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:58.336759 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1266/2565] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:58.346836 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:58.348379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:58.394245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:58.412619 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b868ab3-0227-4e63-9b32-fb968e2d10e0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:58.416738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:58.417363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:58.417637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:58.417906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:58.427425 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:58.428919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:58.439103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1300/2566] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:44:58.727556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:58.729302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:58.743214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f349a-9c94-4949-8e57-ba0acec58dcc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:58.748330 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:58.748972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:58.749394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:58.749691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] PATH_INFO: `/v3/projects/0626d20292b141cdb1ab012e978e6bed` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:58.750857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0626d20292b141cdb1ab012e978e6bed)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:58.752827 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:58.804522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0626d20292b141cdb1ab012e978e6bed', 'request_id': 'req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.814596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0626d20292b141cdb1ab012e978e6bed', 'request_id': 'req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.822428 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0626d20292b141cdb1ab012e978e6bed', 'request_id': 'req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.833794 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] The token cache is being invalidate because project 0626d20292b141cdb1ab012e978e6bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:44:58.834080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.834731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.836282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1267/2567] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:44:58 2022] DELETE /identity/v3/projects/0626d20292b141cdb1ab012e978e6bed => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:58.840455 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:58.850500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b110d9-732a-491e-adac-2b5545e57b0b service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:58.912166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:58.912858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:58.913137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:58.913413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] PATH_INFO: `/v3/users/3813af02f6f9443882607513d3aaf73a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:58.914563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3813af02f6f9443882607513d3aaf73a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:58.916558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:58.968742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3813af02f6f9443882607513d3aaf73a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.969385 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3813af02f6f9443882607513d3aaf73a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.976753 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3813af02f6f9443882607513d3aaf73a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.977542 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3813af02f6f9443882607513d3aaf73a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:58.985985 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8b378a2c-8f59-4f82-b62b-d308f65731c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3813af02f6f9443882607513d3aaf73a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:59.004440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1301/2568] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:44:58 2022] DELETE /identity/v3/users/3813af02f6f9443882607513d3aaf73a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:59.305266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:59.307528 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:59.325546 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ded7f2-3d2c-4cdc-9cc1-6e3129fca72e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:59.394158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:59.394894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.395176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.395450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] PATH_INFO: `/v3/projects/9f0f486f677a4d54befc4666d04b9bf3` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.396609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0f486f677a4d54befc4666d04b9bf3)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:59.398543 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:59.444051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:59.448014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0f486f677a4d54befc4666d04b9bf3', 'request_id': 'req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:59.458785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0f486f677a4d54befc4666d04b9bf3', 'request_id': 'req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:59.465381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0f486f677a4d54befc4666d04b9bf3', 'request_id': 'req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:59.476611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] The token cache is being invalidate because project 9f0f486f677a4d54befc4666d04b9bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:44:59.476832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:59.477506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-aa56148f-0c27-4c1d-bcf4-5df9bb693fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:44:59.479031 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1268/2569] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:44:59 2022] DELETE /identity/v3/projects/9f0f486f677a4d54befc4666d04b9bf3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:59.484270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9425-ec85-4676-8c04-369cd74af0db None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.484734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9425-ec85-4676-8c04-369cd74af0db None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.484843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9425-ec85-4676-8c04-369cd74af0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.505630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-160f9425-ec85-4676-8c04-369cd74af0db None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:59.506831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-160f9425-ec85-4676-8c04-369cd74af0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:59.569951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1302/2570] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:44:59.583454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721727d3-a726-4812-bd0d-e0078eb08c7d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.583765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721727d3-a726-4812-bd0d-e0078eb08c7d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.584064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721727d3-a726-4812-bd0d-e0078eb08c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.603836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-721727d3-a726-4812-bd0d-e0078eb08c7d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:59.605152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-721727d3-a726-4812-bd0d-e0078eb08c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:44:59.614657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1269/2571] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:44:59.619262 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f9425-ec85-4676-8c04-369cd74af0db None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:59.624224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:44:59.630967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f9425-ec85-4676-8c04-369cd74af0db None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:59.637077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:59.637741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.638022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.638297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.638951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:44:59.639265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:59.640967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:59.653402 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1303/2572] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:44:59.657840 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721727d3-a726-4812-bd0d-e0078eb08c7d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:59.667557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721727d3-a726-4812-bd0d-e0078eb08c7d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:59.673203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:59.673798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.674077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.674348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.674972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:59.677367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:59.708439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1270/2573] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:44:59 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:44:59.712863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:59.723184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76125-669c-4b3e-a7bf-c34b9e0e68fd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:59.781565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:59.782098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.782400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.782676 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.783293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:59.785365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:59.808196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1304/2574] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:44:59 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:44:59.812693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:59.824518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2b01c-5b21-45df-8cb3-390b51324235 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:59.829323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:59.829922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.830207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.830483 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.831151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:59.832790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:59.842894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1271/2575] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:59.847929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:59.858462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11555-4910-44ad-b69e-9c56451b08e1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:59.863909 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740c41e-9a9d-4462-8678-5482e5564856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:59.864558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740c41e-9a9d-4462-8678-5482e5564856 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.864877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740c41e-9a9d-4462-8678-5482e5564856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.865149 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740c41e-9a9d-4462-8678-5482e5564856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.865783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740c41e-9a9d-4462-8678-5482e5564856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:59.867362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740c41e-9a9d-4462-8678-5482e5564856 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:59.878323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1305/2576] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:44:59.882695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:44:59.893346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc056a-4e8a-4de7-9422-2f51591df675 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:44:59.898383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:44:59.899023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.899295 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.899565 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] PATH_INFO: `/v3/projects/722e2a14be214fdd946c52060c325011/users/455f195260064dd4829876fbd93464ab/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.914741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] RBAC: Authorizing `identity:create_grant(project_id=722e2a14be214fdd946c52060c325011, user_id=455f195260064dd4829876fbd93464ab, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:44:59.917466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:44:59.932805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1272/2577] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:44:59 2022] PUT /identity/v3/projects/722e2a14be214fdd946c52060c325011/users/455f195260064dd4829876fbd93464ab/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:44:59.944319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715983a3-bbfb-46d4-a775-f6d257ea10fc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:44:59.944652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715983a3-bbfb-46d4-a775-f6d257ea10fc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:44:59.944939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715983a3-bbfb-46d4-a775-f6d257ea10fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:44:59.995817 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-715983a3-bbfb-46d4-a775-f6d257ea10fc None None] MFA Rules not processed for user `455f195260064dd4829876fbd93464ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:44:59.997071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-715983a3-bbfb-46d4-a775-f6d257ea10fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:00.073101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1306/2578] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:00.077795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.151619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd996-d8f6-4bd5-81aa-9a6c6754002a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.157299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.157891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.158166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.158436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.159052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.161001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.192841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1273/2579] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:00 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:00.197247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715983a3-bbfb-46d4-a775-f6d257ea10fc None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.208969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715983a3-bbfb-46d4-a775-f6d257ea10fc None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.262863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:00.273121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.273890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.274288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.274630 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.275342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.277631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.301597 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1307/2580] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:00 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:00.305482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.317366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c9ab-c622-43f0-9c0f-4d7e03362f62 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.321580 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.322332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.322614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.322912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.323631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.325199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.336559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1274/2581] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:00.340740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.353171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fd52a-417a-43fd-8c21-ea189af15c3b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.370089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.370918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.371285 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.371770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] PATH_INFO: `/v3/projects/6de6fc9a52ea40158f0f41bb3dba248f/users/6646ffe840de41f2ae521f390e61947b/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.389910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de6fc9a52ea40158f0f41bb3dba248f, user_id=6646ffe840de41f2ae521f390e61947b, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.393164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.408856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1308/2582] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:00 2022] PUT /identity/v3/projects/6de6fc9a52ea40158f0f41bb3dba248f/users/6646ffe840de41f2ae521f390e61947b/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:00.413967 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.428184 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b6118-ac53-4dd6-a85d-26e5bdd08348 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.492579 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:00.511498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ddff2-63b0-4cb9-8530-2d4d3e835759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.512318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ddff2-63b0-4cb9-8530-2d4d3e835759 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.512695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ddff2-63b0-4cb9-8530-2d4d3e835759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.513098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ddff2-63b0-4cb9-8530-2d4d3e835759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.514116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ddff2-63b0-4cb9-8530-2d4d3e835759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.515985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ddff2-63b0-4cb9-8530-2d4d3e835759 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.527205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1275/2583] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:00.531951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.544293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d0e5-30bd-4159-8bd3-63ad5517ab30 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.549445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.550172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.550584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.551267 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] PATH_INFO: `/v3/projects/6de6fc9a52ea40158f0f41bb3dba248f/users/6646ffe840de41f2ae521f390e61947b/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.552978 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de6fc9a52ea40158f0f41bb3dba248f, user_id=6646ffe840de41f2ae521f390e61947b, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.555665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.567864 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1309/2584] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:00 2022] PUT /identity/v3/projects/6de6fc9a52ea40158f0f41bb3dba248f/users/6646ffe840de41f2ae521f390e61947b/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:00.579571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.579799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.580109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.609325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] MFA Rules not processed for user `6646ffe840de41f2ae521f390e61947b`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:00.610544 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:00.681814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1276/2585] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:00.694005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.696068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:00.763520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c9159-4d10-4810-9532-9b33272bdfd2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.768511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.769259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.769466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.769877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.779699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.781226 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.791154 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1310/2586] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:00.840151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:00.841826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:00.855003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797b6a5-7a21-4630-93b6-7fb047c04eb1 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:00.859213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:00.859848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:00.860130 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:00.860404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:00.932445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:00.933893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:00.943188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1277/2587] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:01.747850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:01.757348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b464e-d7a1-48ec-b539-5339cd3a8257 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:01.761740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:01.762364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:01.762780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:01.763061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:01.765031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:01.827790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:01.829242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:01.838253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1311/2588] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:02.619222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:02.628351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f006a7-d7e2-4e3e-8d91-6a1ada83085f service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:02.632761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0dc26-d9df-4112-8b9d-1e6530ff79a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:02.633442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0dc26-d9df-4112-8b9d-1e6530ff79a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:02.633791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0dc26-d9df-4112-8b9d-1e6530ff79a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:02.634136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0dc26-d9df-4112-8b9d-1e6530ff79a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:02.636559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-72c0dc26-d9df-4112-8b9d-1e6530ff79a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:02.706529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0dc26-d9df-4112-8b9d-1e6530ff79a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:02.710488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0dc26-d9df-4112-8b9d-1e6530ff79a7 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:02.722060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1278/2589] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:04.052405 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:04.054281 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:04.110712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:04.125145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2db99-03a3-416b-9912-15a427e57733 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:04.130058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:04.130736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:04.131086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:04.131299 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] PATH_INFO: `/v3/users/047de9f722584df0a79d0f1290d7c237` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:04.134951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=047de9f722584df0a79d0f1290d7c237)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:04.134951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:04.187009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047de9f722584df0a79d0f1290d7c237'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.187712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047de9f722584df0a79d0f1290d7c237'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.195685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047de9f722584df0a79d0f1290d7c237'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.196662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047de9f722584df0a79d0f1290d7c237'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.211452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047de9f722584df0a79d0f1290d7c237'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.239960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1312/2590] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:04 2022] DELETE /identity/v3/users/047de9f722584df0a79d0f1290d7c237 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:04.245171 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:04.245720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:04.245833 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:04.253790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:04.271424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:04.273177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:04.347547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1279/2591] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:04.357589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:04.359100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:04.412808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:04.414301 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:04.426943 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6ee9a-ac00-4bc5-bed5-e9c62a64ad6d None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:04.431722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:04.432422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:04.432731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:04.432953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] PATH_INFO: `/v3/users/455f195260064dd4829876fbd93464ab` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:04.434108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455f195260064dd4829876fbd93464ab)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:04.436113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:04.443136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b45c-d8e5-428a-be97-d4f00f4c67bd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:04.447066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f10e8-730e-4179-a137-c797b30c5378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:04.447778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f10e8-730e-4179-a137-c797b30c5378 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:04.448060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f10e8-730e-4179-a137-c797b30c5378 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:04.448342 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f10e8-730e-4179-a137-c797b30c5378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:04.457881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f10e8-730e-4179-a137-c797b30c5378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:04.459318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f10e8-730e-4179-a137-c797b30c5378 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:04.469998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1313/2592] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:04.489397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455f195260064dd4829876fbd93464ab'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.497174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455f195260064dd4829876fbd93464ab'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.512531 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455f195260064dd4829876fbd93464ab'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.524107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455f195260064dd4829876fbd93464ab'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.524890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455f195260064dd4829876fbd93464ab'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:04.533473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1280/2593] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:04 2022] DELETE /identity/v3/users/455f195260064dd4829876fbd93464ab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:04.539183 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:04.539707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:04.540059 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:04.563627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:04.564993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:04.635325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1314/2594] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:04.646898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:04.648542 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:04.709786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98296275-c13e-4fa0-81b2-83873497ba68 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:04.713551 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:04.714172 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:04.714454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:04.714758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:04.724452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:04.725905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:04.736133 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1281/2595] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:04.926412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:04.928692 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:04.940807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70705d-73a1-4e13-8296-a2ff12b52af4 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:04.945997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:04.947143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:04.947677 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:04.948017 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] PATH_INFO: `/v3/projects/3e44742311c44ed196b22ba354d9a958` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:04.949238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e44742311c44ed196b22ba354d9a958)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:04.951318 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:04.960923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:05.023205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e44742311c44ed196b22ba354d9a958', 'request_id': 'req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.031130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e44742311c44ed196b22ba354d9a958', 'request_id': 'req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.041258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:05.041438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e44742311c44ed196b22ba354d9a958', 'request_id': 'req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.042876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:05.057851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] The token cache is being invalidate because project 3e44742311c44ed196b22ba354d9a958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:05.058376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.058874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.064713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1315/2596] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:04 2022] DELETE /identity/v3/projects/3e44742311c44ed196b22ba354d9a958 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:05.065752 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:05.067279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33026d-db8d-46b1-9044-a253ebbc1252 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:05.068038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:05.092225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:05.144668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1dd40-d8c7-458b-ab42-351ff1eb5f5a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:05.150370 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:05.150648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:05.151534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:05.151534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:05.151802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:05.151989 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] PATH_INFO: `/v3/users/90fd22d5525e42e7bd1b3977b1c44d1e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:05.152100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:05.152729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] PATH_INFO: `/v3/projects/722e2a14be214fdd946c52060c325011` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:05.153328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fd22d5525e42e7bd1b3977b1c44d1e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:05.153924 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=722e2a14be214fdd946c52060c325011)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:05.155413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:05.156210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:05.214678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722e2a14be214fdd946c52060c325011', 'request_id': 'req-6807120f-c55d-4718-8ea5-a3023c86e07f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.225371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722e2a14be214fdd946c52060c325011', 'request_id': 'req-6807120f-c55d-4718-8ea5-a3023c86e07f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.233388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fd22d5525e42e7bd1b3977b1c44d1e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.234091 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fd22d5525e42e7bd1b3977b1c44d1e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.234764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722e2a14be214fdd946c52060c325011', 'request_id': 'req-6807120f-c55d-4718-8ea5-a3023c86e07f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.244418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fd22d5525e42e7bd1b3977b1c44d1e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.246517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fd22d5525e42e7bd1b3977b1c44d1e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.248746 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] The token cache is being invalidate because project 722e2a14be214fdd946c52060c325011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:05.249211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.249809 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.251678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1282/2597] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:05 2022] DELETE /identity/v3/projects/722e2a14be214fdd946c52060c325011 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:05.256429 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:05.258329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:05.260367 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fd22d5525e42e7bd1b3977b1c44d1e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.282312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1316/2598] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:05 2022] DELETE /identity/v3/users/90fd22d5525e42e7bd1b3977b1c44d1e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:05.330610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807120f-c55d-4718-8ea5-a3023c86e07f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:05.394802 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:05.404750 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:05.405825 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:05.406183 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:05.406558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] PATH_INFO: `/v3/users/6646ffe840de41f2ae521f390e61947b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:05.408123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6646ffe840de41f2ae521f390e61947b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:05.410775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:05.481672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6646ffe840de41f2ae521f390e61947b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.498507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6646ffe840de41f2ae521f390e61947b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.517069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6646ffe840de41f2ae521f390e61947b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.527734 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6646ffe840de41f2ae521f390e61947b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.528521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6646ffe840de41f2ae521f390e61947b'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:05.538623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1283/2599] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:05 2022] DELETE /identity/v3/users/6646ffe840de41f2ae521f390e61947b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:05.628921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:05.631141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:05.676447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:05.766314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8241201-0596-4570-b2c0-228608712a5c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:05.799639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:05.801137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:05.918138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:05.919944 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:05.920561 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:05.921181 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:05.922929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37462b3-6da2-4ea2-b296-2c7f27ee20a0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:05.923251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:05.928152 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:05.928964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:05.929346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:05.929691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] PATH_INFO: `/v3/projects/3ab3ef0f92474380b74b5d33c0141af9` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:05.930923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab3ef0f92474380b74b5d33c0141af9)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:05.932952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:05.942465 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:05.944532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:05.960212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1317/2600] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:06.009711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab3ef0f92474380b74b5d33c0141af9', 'request_id': 'req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.023121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.024795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:06.035430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab3ef0f92474380b74b5d33c0141af9', 'request_id': 'req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.043013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab3ef0f92474380b74b5d33c0141af9', 'request_id': 'req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.055003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c406f0-9792-43ab-8efc-dae2543a590e service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.061176 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] The token cache is being invalidate because project 3ab3ef0f92474380b74b5d33c0141af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:06.061468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.062124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.064140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1284/2601] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:05 2022] DELETE /identity/v3/projects/3ab3ef0f92474380b74b5d33c0141af9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:06.070767 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.078421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:06.085941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:06.161504 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.163005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.163740 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.164078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06fa29-7ac4-4cab-bd73-5d808e6419ff admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.164562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] PATH_INFO: `/v3/projects/6de6fc9a52ea40158f0f41bb3dba248f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.166549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de6fc9a52ea40158f0f41bb3dba248f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.171030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.174613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.175268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.175860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.175972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] PATH_INFO: `/v3/users/e1881d99eb004a768a11f89512eeea8e` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.177280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1881d99eb004a768a11f89512eeea8e)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.183143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.224089 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:06.234138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de6fc9a52ea40158f0f41bb3dba248f', 'request_id': 'req-305267bb-c52f-49b1-be1e-e338d3194c45'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.242861 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de6fc9a52ea40158f0f41bb3dba248f', 'request_id': 'req-305267bb-c52f-49b1-be1e-e338d3194c45'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.249943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de6fc9a52ea40158f0f41bb3dba248f', 'request_id': 'req-305267bb-c52f-49b1-be1e-e338d3194c45'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.261799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1881d99eb004a768a11f89512eeea8e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.262794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] The token cache is being invalidate because project 6de6fc9a52ea40158f0f41bb3dba248f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:06.263031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.263709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-305267bb-c52f-49b1-be1e-e338d3194c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.265250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1318/2602] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:06 2022] DELETE /identity/v3/projects/6de6fc9a52ea40158f0f41bb3dba248f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:06.270666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303b4e-4995-4f1e-af9b-2586c332aa16 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.270955 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303b4e-4995-4f1e-af9b-2586c332aa16 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.271231 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13303b4e-4995-4f1e-af9b-2586c332aa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.275181 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1881d99eb004a768a11f89512eeea8e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.289478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1881d99eb004a768a11f89512eeea8e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.292779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-13303b4e-4995-4f1e-af9b-2586c332aa16 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:06.293667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-13303b4e-4995-4f1e-af9b-2586c332aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:06.299340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1881d99eb004a768a11f89512eeea8e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.305082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-058a6afe-e3fe-4789-8dd1-ff12bcf7ad64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1881d99eb004a768a11f89512eeea8e'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.312394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1285/2603] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:06 2022] DELETE /identity/v3/users/e1881d99eb004a768a11f89512eeea8e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:06.386184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1319/2604] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:06.388389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852165-9159-494e-b6bf-39efe5d63937 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.388859 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852165-9159-494e-b6bf-39efe5d63937 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.389132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8852165-9159-494e-b6bf-39efe5d63937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.412265 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e8852165-9159-494e-b6bf-39efe5d63937 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:06.413526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e8852165-9159-494e-b6bf-39efe5d63937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:06.481395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1286/2605] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:06.485918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303b4e-4995-4f1e-af9b-2586c332aa16 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.499251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13303b4e-4995-4f1e-af9b-2586c332aa16 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.506709 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.507445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.507839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.508818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.508818 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:45:06.509171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.510965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.525604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1320/2606] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:45:06.530247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8852165-9159-494e-b6bf-39efe5d63937 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.541304 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8852165-9159-494e-b6bf-39efe5d63937 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.547048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.547717 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.547998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.548275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.548912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.551927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.586294 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1287/2607] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:06 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:06.590326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.605829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60cc10-9c1f-4113-8ab0-0b80f22d6f07 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.670755 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.672426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:06.678898 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:06.706237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.707565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.708312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.708821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.709704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.712050 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.743888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1321/2608] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:06 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:06.747765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.759108 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc1191-65f0-4352-be8c-dce4c346d5d2 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.764690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.765648 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.766110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.766796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.768530 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.771039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.774284 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6b9a3-6218-4d9a-b52a-b9fbb49d3a71 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.783019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.783868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.784220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.784745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] PATH_INFO: `/v3/projects/e5a453444579464483098b762664413d` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.785451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1322/2609] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:06.786324 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a453444579464483098b762664413d)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.788619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.789639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.801327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762988b4-169e-4b9c-96f2-2e9437df72dd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.810555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.812695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.813179 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.815410 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.816314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.818691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.837960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1323/2610] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:06.842972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:06.856683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd300c23-6851-4f78-b38c-2d88dabfa7e4 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:06.863617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd95a8-7214-402b-8473-a7059bafb1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:06.864599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd95a8-7214-402b-8473-a7059bafb1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.864886 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd95a8-7214-402b-8473-a7059bafb1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.865218 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd95a8-7214-402b-8473-a7059bafb1a1 admin admin] PATH_INFO: `/v3/projects/47053a21bc9a4408bba1bd2704a61ca8/users/bda3c36098274d7e914ed386f5341bf6/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.883533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a453444579464483098b762664413d', 'request_id': 'req-224b043f-da15-4385-941b-b16202f513c7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.884150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd95a8-7214-402b-8473-a7059bafb1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47053a21bc9a4408bba1bd2704a61ca8, user_id=bda3c36098274d7e914ed386f5341bf6, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:06.887242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd95a8-7214-402b-8473-a7059bafb1a1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:06.895414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a453444579464483098b762664413d', 'request_id': 'req-224b043f-da15-4385-941b-b16202f513c7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.898720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:06.903962 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a453444579464483098b762664413d', 'request_id': 'req-224b043f-da15-4385-941b-b16202f513c7'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.907539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1324/2611] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:06 2022] PUT /identity/v3/projects/47053a21bc9a4408bba1bd2704a61ca8/users/bda3c36098274d7e914ed386f5341bf6/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:06.918663 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.919197 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.919719 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] The token cache is being invalidate because project e5a453444579464483098b762664413d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:06.920130 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.920259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.921034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-224b043f-da15-4385-941b-b16202f513c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:06.922830 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1288/2612] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:06 2022] DELETE /identity/v3/projects/e5a453444579464483098b762664413d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:06.931440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e083f99-a7dd-4e6e-8cc4-eb7cd3c88459 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:06.931760 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e083f99-a7dd-4e6e-8cc4-eb7cd3c88459 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:06.932144 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e083f99-a7dd-4e6e-8cc4-eb7cd3c88459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:06.958415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0e083f99-a7dd-4e6e-8cc4-eb7cd3c88459 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:06.959699 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0e083f99-a7dd-4e6e-8cc4-eb7cd3c88459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:06.967518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] MFA Rules not processed for user `bda3c36098274d7e914ed386f5341bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:06.968770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:07.030952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1289/2613] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:07.040285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9d24-648c-4d0a-a55b-1e8abf2793f9 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.040571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9d24-648c-4d0a-a55b-1e8abf2793f9 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.040852 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9d24-648c-4d0a-a55b-1e8abf2793f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.049540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1325/2614] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:07.053938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.055734 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:07.063725 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-fd5f9d24-648c-4d0a-a55b-1e8abf2793f9 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:07.065291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-fd5f9d24-648c-4d0a-a55b-1e8abf2793f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:07.070571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd83fe-3f66-452b-8efb-abcc6ddf89b3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.075550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1290/2615] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:07.075699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.076363 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.076531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.076785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.077540 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.079612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.080092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f9d24-648c-4d0a-a55b-1e8abf2793f9 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.090732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f9d24-648c-4d0a-a55b-1e8abf2793f9 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.095562 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.096229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.096509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.096805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.097486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:45:07.098163 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.099470 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.115977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1291/2616] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:45:07.117017 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.118146 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1326/2617] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:45:07.121982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.130433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfc293-aa80-4d37-bb41-35afcfa5f574 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.140271 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:07.198578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760bfb-3982-45b2-84c8-457182b5b191 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.202430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.203060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.203341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.203643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.203781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.204389 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.204584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.204983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.205341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.206143 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.206467 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.208417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.237150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1327/2618] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:07.238831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.244804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1292/2619] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:07.249582 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.252347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57b015-1e04-46f2-9228-f77b24b4fd5a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.315869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:07.323877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.325366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.325574 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ec33-7aeb-434c-a317-636e700cccb8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.326083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.326655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.327444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.329282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.330946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.332903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.332903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.333139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.333775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.335916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.341356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1328/2620] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:07.345476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.357065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8f56-a386-4fb2-a798-64fa6e1ea1aa admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.361043 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1293/2621] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:45:07.365467 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.366144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.366424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.366539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.366733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] PATH_INFO: `/v3/projects/27d309e5fe794888aaf41c31d326663c/users/6b93514523da474d8d1768e4eb2b457c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.378442 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649e93c-cc12-4478-8746-55ba487e7d93 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.385368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.386073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.386423 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.386763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.387068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d309e5fe794888aaf41c31d326663c, user_id=6b93514523da474d8d1768e4eb2b457c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.387558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.389293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.391382 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.401609 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1294/2622] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:07.405652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.409979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1329/2623] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:07 2022] PUT /identity/v3/projects/27d309e5fe794888aaf41c31d326663c/users/6b93514523da474d8d1768e4eb2b457c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:07.413629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.417682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b2df7-7def-4988-a7a6-e290e1195c55 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.501273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.502052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.502336 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.502471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a4d3-283f-4481-acd6-5ee7a51c04f1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.502623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.504471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.506482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.507687 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.508439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.508837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.509117 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.509837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.511555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.523757 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1295/2625] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:07.524828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.526323 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1330/2624] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:07.527220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.538218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28843f-c27c-4499-8e63-13566f8aa513 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.538419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aa853-7c2f-4f9a-a050-5b39498a69fd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.543803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6771a4-bc97-49de-b5cc-5aa7eff3d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.544578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6771a4-bc97-49de-b5cc-5aa7eff3d440 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.544905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6771a4-bc97-49de-b5cc-5aa7eff3d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.545085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89fa27-466c-4ed7-875d-38828cabad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.545209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6771a4-bc97-49de-b5cc-5aa7eff3d440 admin admin] PATH_INFO: `/v3/projects/27d309e5fe794888aaf41c31d326663c/users/6b93514523da474d8d1768e4eb2b457c/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.546015 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89fa27-466c-4ed7-875d-38828cabad02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.546657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89fa27-466c-4ed7-875d-38828cabad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.546919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89fa27-466c-4ed7-875d-38828cabad02 admin admin] PATH_INFO: `/v3/projects/a4b4cdb7b2e84f3b9c6042c686cdaeff/users/2161ed9e96f646a4b0d16df2d1a60076/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.547233 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6771a4-bc97-49de-b5cc-5aa7eff3d440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d309e5fe794888aaf41c31d326663c, user_id=6b93514523da474d8d1768e4eb2b457c, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.549986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6771a4-bc97-49de-b5cc-5aa7eff3d440 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.561431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1331/2626] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:07 2022] PUT /identity/v3/projects/27d309e5fe794888aaf41c31d326663c/users/6b93514523da474d8d1768e4eb2b457c/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:07.563566 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:07.569057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89fa27-466c-4ed7-875d-38828cabad02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b4cdb7b2e84f3b9c6042c686cdaeff, user_id=2161ed9e96f646a4b0d16df2d1a60076, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.573057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.573345 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.573454 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89fa27-466c-4ed7-875d-38828cabad02 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.573614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.587358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1296/2627] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:07 2022] PUT /identity/v3/projects/a4b4cdb7b2e84f3b9c6042c686cdaeff/users/2161ed9e96f646a4b0d16df2d1a60076/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:07.599930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.600214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.600490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.603614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] MFA Rules not processed for user `6b93514523da474d8d1768e4eb2b457c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:07.604872 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:07.629238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] MFA Rules not processed for user `2161ed9e96f646a4b0d16df2d1a60076`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:07.630463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:07.680461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1332/2628] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:07.692423 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.694324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:07.698765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1297/2629] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:07.718468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.719931 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:07.738743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:07.759547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fee20c-966d-4370-bce8-4643f6be0308 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.763853 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.764625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.764887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.765162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.778962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.780559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.786280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635cc35-9303-4838-bc9a-238ab8cd032c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.789860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.790472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.790748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.791259 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.791376 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1333/2630] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:07.800055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.801628 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.810766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1298/2631] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:07.831878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.860681 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:07.899364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dee3fd-e6f6-4126-aafc-5f8e1471acc2 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.904300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.904946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.905219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.905477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] PATH_INFO: `/v3/users/2161ed9e96f646a4b0d16df2d1a60076` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.906592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2161ed9e96f646a4b0d16df2d1a60076)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.908531 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.925494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc19fb9-3515-4f17-8b80-398ebda76b5c service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:07.930211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:07.930846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.931125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.931401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] PATH_INFO: `/v3/users/bda3c36098274d7e914ed386f5341bf6` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:07.932592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda3c36098274d7e914ed386f5341bf6)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:07.934504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:07.955888 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2161ed9e96f646a4b0d16df2d1a60076'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:07.956565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2161ed9e96f646a4b0d16df2d1a60076'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:07.957923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:07.965458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2161ed9e96f646a4b0d16df2d1a60076'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:07.966136 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2161ed9e96f646a4b0d16df2d1a60076'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:07.973993 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9af2e7f8-ef79-4f38-8366-d23c43b28c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2161ed9e96f646a4b0d16df2d1a60076'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:07.985669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda3c36098274d7e914ed386f5341bf6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:07.993266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda3c36098274d7e914ed386f5341bf6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:07.993973 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1334/2632] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:07 2022] DELETE /identity/v3/users/2161ed9e96f646a4b0d16df2d1a60076 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:07.998599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:07.998912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:07.999174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.009046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda3c36098274d7e914ed386f5341bf6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.017732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda3c36098274d7e914ed386f5341bf6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.018302 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:08.018692 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b636750e-1e98-49ef-aeb8-b2de0bb42a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda3c36098274d7e914ed386f5341bf6'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.019926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:08.025115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1299/2633] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:07 2022] DELETE /identity/v3/users/bda3c36098274d7e914ed386f5341bf6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:08.029489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:08.029772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:08.030061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.050371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:08.051647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:08.073790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:08.094111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1335/2634] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:08.104613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:08.106097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:08.116358 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1300/2635] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:08.126845 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:08.128390 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:08.166972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7975fb-f43d-49bb-a526-87f5e214ca33 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:08.186285 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ef2a1-3409-4f52-9889-40dd99734f60 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:08.189983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:08.190589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:08.190868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:08.191186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.200415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:08.201947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:08.212239 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1301/2636] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:08.218075 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:08.218697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:08.218977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:08.219250 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.230157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:08.231775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:08.242517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1336/2637] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:08.646597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:08.648354 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:08.679032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eb9e-0d41-409d-ae97-94c70ea2f018 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:08.691621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:08.692298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:08.692722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:08.693027 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] PATH_INFO: `/v3/projects/47053a21bc9a4408bba1bd2704a61ca8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.697596 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47053a21bc9a4408bba1bd2704a61ca8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:08.699741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:08.700923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:08.702577 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:08.716003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f9509-660e-4bb8-b682-87ec1337fd50 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:08.720799 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:08.721497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:08.721841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:08.722546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] PATH_INFO: `/v3/projects/a4b4cdb7b2e84f3b9c6042c686cdaeff` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.723612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b4cdb7b2e84f3b9c6042c686cdaeff)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:08.725563 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:08.772346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:08.784338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47053a21bc9a4408bba1bd2704a61ca8', 'request_id': 'req-5a8041b1-f951-43fc-bf5e-ab740f21d222'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.796475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47053a21bc9a4408bba1bd2704a61ca8', 'request_id': 'req-5a8041b1-f951-43fc-bf5e-ab740f21d222'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.798044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b4cdb7b2e84f3b9c6042c686cdaeff', 'request_id': 'req-f5ba1198-a42e-45f5-a419-4addc2b1b152'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.805665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b4cdb7b2e84f3b9c6042c686cdaeff', 'request_id': 'req-f5ba1198-a42e-45f5-a419-4addc2b1b152'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.806829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47053a21bc9a4408bba1bd2704a61ca8', 'request_id': 'req-5a8041b1-f951-43fc-bf5e-ab740f21d222'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.813026 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b4cdb7b2e84f3b9c6042c686cdaeff', 'request_id': 'req-f5ba1198-a42e-45f5-a419-4addc2b1b152'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.821032 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] The token cache is being invalidate because project 47053a21bc9a4408bba1bd2704a61ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:08.821323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.822072 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.826764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1302/2638] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:08 2022] DELETE /identity/v3/projects/47053a21bc9a4408bba1bd2704a61ca8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:08.827635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:08.829198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:08.837523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] The token cache is being invalidate because project a4b4cdb7b2e84f3b9c6042c686cdaeff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:08.837829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.838522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-f5ba1198-a42e-45f5-a419-4addc2b1b152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:08.840191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1337/2639] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:08 2022] DELETE /identity/v3/projects/a4b4cdb7b2e84f3b9c6042c686cdaeff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:08.845348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fa5e-e055-418d-b595-de8898c5b4cc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:08.845625 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fa5e-e055-418d-b595-de8898c5b4cc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:08.845893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fa5e-e055-418d-b595-de8898c5b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.901556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8041b1-f951-43fc-bf5e-ab740f21d222 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:08.971188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:08.971970 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:08.972251 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:08.972710 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] PATH_INFO: `/v3/users/6b93514523da474d8d1768e4eb2b457c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:08.974350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b93514523da474d8d1768e4eb2b457c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:08.976224 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:08.995097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fdf5fa5e-e055-418d-b595-de8898c5b4cc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:08.996474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fdf5fa5e-e055-418d-b595-de8898c5b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.005574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1338/2640] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:09.013336 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd780-8dd1-4272-886f-bdf1a3fc3594 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.013621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd780-8dd1-4272-886f-bdf1a3fc3594 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.013890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd780-8dd1-4272-886f-bdf1a3fc3594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.025820 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b93514523da474d8d1768e4eb2b457c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.033159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b93514523da474d8d1768e4eb2b457c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.033789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-97fbd780-8dd1-4272-886f-bdf1a3fc3594 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:09.035081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-97fbd780-8dd1-4272-886f-bdf1a3fc3594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.043823 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1339/2641] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:09.048196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd780-8dd1-4272-886f-bdf1a3fc3594 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.049647 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b93514523da474d8d1768e4eb2b457c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.052438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:09.060126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b93514523da474d8d1768e4eb2b457c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.061212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd780-8dd1-4272-886f-bdf1a3fc3594 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.061570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b93514523da474d8d1768e4eb2b457c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.067296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.067951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.068229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.068508 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.069159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:45:09.069461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.069885 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1303/2642] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:08 2022] DELETE /identity/v3/users/6b93514523da474d8d1768e4eb2b457c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:09.073213 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.087103 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1340/2643] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:45:09.089089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.090572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.159065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210a5e1-79e2-4b6b-b284-ee06d625f557 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.164573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.165274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.165631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.165904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.166571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.168607 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.200966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1304/2644] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:45:09.202253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.212810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccb70-3a8d-43ef-85e7-02a19f4763c0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.227904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:09.279905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.280606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.280953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.281291 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.281982 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.284294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.306841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1341/2645] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:45:09.311113 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.322445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe864-b5f2-4ad0-96fd-a885be2d0a33 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.327276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.327878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.328156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.328387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.329048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.330648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.342573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1305/2646] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:09.346758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.358158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0c658-bf5f-49cd-817b-7473d70754b1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.360180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.361875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.363701 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.364311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.364584 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.364850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.365665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.367341 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.377328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465acb79-db3f-42bb-86dc-763c84db4d43 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.378221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1342/2647] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:09.382488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.386448 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.387273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.387635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.387848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] PATH_INFO: `/v3/projects/27d309e5fe794888aaf41c31d326663c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.389014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d309e5fe794888aaf41c31d326663c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.391081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.394377 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387475-21ed-4e96-b368-694e7c41a30c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.399436 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1353c-0c24-4127-9bd7-7f613ba5bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.400327 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1353c-0c24-4127-9bd7-7f613ba5bb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.400602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1353c-0c24-4127-9bd7-7f613ba5bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.400881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1353c-0c24-4127-9bd7-7f613ba5bb17 admin admin] PATH_INFO: `/v3/projects/7011dfa8ba6a4670ac2212329705a012/users/f45ffa9a12e14ba48163d45383cfcabb/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.416360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1353c-0c24-4127-9bd7-7f613ba5bb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7011dfa8ba6a4670ac2212329705a012, user_id=f45ffa9a12e14ba48163d45383cfcabb, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.419243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1353c-0c24-4127-9bd7-7f613ba5bb17 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.432903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1343/2648] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:09 2022] PUT /identity/v3/projects/7011dfa8ba6a4670ac2212329705a012/users/f45ffa9a12e14ba48163d45383cfcabb/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:09.440705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d309e5fe794888aaf41c31d326663c', 'request_id': 'req-13a145a4-82e7-408e-9c29-2a48d1139b9f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.443505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.443868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.444164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.448337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d309e5fe794888aaf41c31d326663c', 'request_id': 'req-13a145a4-82e7-408e-9c29-2a48d1139b9f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.456109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d309e5fe794888aaf41c31d326663c', 'request_id': 'req-13a145a4-82e7-408e-9c29-2a48d1139b9f'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.466905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] The token cache is being invalidate because project 27d309e5fe794888aaf41c31d326663c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:09.467192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.467890 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-13a145a4-82e7-408e-9c29-2a48d1139b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.469421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1306/2649] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:09 2022] DELETE /identity/v3/projects/27d309e5fe794888aaf41c31d326663c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:09.475274 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9b07-7216-4cde-b623-bf79a1f87ce3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.475554 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9b07-7216-4cde-b623-bf79a1f87ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.475869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae9b07-7216-4cde-b623-bf79a1f87ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.477911 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] MFA Rules not processed for user `f45ffa9a12e14ba48163d45383cfcabb`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:09.479156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.502392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e4ae9b07-7216-4cde-b623-bf79a1f87ce3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:09.503700 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e4ae9b07-7216-4cde-b623-bf79a1f87ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.545819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1344/2650] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:09.551036 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:09.557908 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.559432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.568356 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1307/2651] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:09.576347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4a578-e10f-48d5-bf8a-4cc42a1e18de None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.576640 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4a578-e10f-48d5-bf8a-4cc42a1e18de None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.576925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4a578-e10f-48d5-bf8a-4cc42a1e18de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.596564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-65a4a578-e10f-48d5-bf8a-4cc42a1e18de None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:09.597737 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-65a4a578-e10f-48d5-bf8a-4cc42a1e18de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.605695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1308/2652] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:09.609942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4a578-e10f-48d5-bf8a-4cc42a1e18de None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.618399 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a5328-888b-40d4-b623-7c0fc5495791 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.619346 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4a578-e10f-48d5-bf8a-4cc42a1e18de None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.622014 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.622623 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.622902 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.623173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.624688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.625286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.625567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.625841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.626496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:45:09.626801 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.628468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.632935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.634390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.641619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1309/2653] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:45:09.643809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1345/2654] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:09.648067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.658672 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd045d-d79f-49d2-b574-636079d6456a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.664038 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.664658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.664942 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.665216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.665851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.667867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.668929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.670468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.679914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:09.685673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49a491-703c-4409-b5e4-eaf9f5df5ee5 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.692362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.692992 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.693282 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.693547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] PATH_INFO: `/v3/users/f45ffa9a12e14ba48163d45383cfcabb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.694691 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45ffa9a12e14ba48163d45383cfcabb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.696693 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.697535 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1310/2655] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:09.701639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.743798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45ffa9a12e14ba48163d45383cfcabb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.744564 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45ffa9a12e14ba48163d45383cfcabb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.751491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45ffa9a12e14ba48163d45383cfcabb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.752171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45ffa9a12e14ba48163d45383cfcabb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.760784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ea7e915a-fe83-420b-885e-049e36fb7c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45ffa9a12e14ba48163d45383cfcabb'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:09.769735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef692-9bc3-4bfa-a349-102df282ac0f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.775122 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.775974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.776373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.776691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.777373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.779385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.780003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1346/2656] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:09 2022] DELETE /identity/v3/users/f45ffa9a12e14ba48163d45383cfcabb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:09.784591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.784918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.785270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.806806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1311/2657] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:45:09.807918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.808156 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:09.809338 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.809826 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.824056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca7841-8341-4721-8ad8-c3ad5a982884 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.879755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1347/2658] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:09.889959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.891498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.903537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.903537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.903537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.903537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.903933 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.905205 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.916003 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1312/2659] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:09.920814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.933030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c9bb6-ce55-44bd-a184-13f342ea02df admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.943824 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.944523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.944941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.945221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.945877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.947570 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.961065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1313/2660] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:09.961065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:09.961065 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.968742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d00bc-eb7b-4283-b150-bc43277e0bac None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.972517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.973056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26126444-2732-4412-86c9-a3949deac13f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:09.973188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.973420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.973714 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.976975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42e46-598c-4df2-a933-a7ed454c8d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:09.977691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42e46-598c-4df2-a933-a7ed454c8d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:09.977979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42e46-598c-4df2-a933-a7ed454c8d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:09.978375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42e46-598c-4df2-a933-a7ed454c8d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:09.980221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6ef42e46-598c-4df2-a933-a7ed454c8d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:09.982721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.984198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.992972 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42e46-598c-4df2-a933-a7ed454c8d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:09.994401 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42e46-598c-4df2-a933-a7ed454c8d5d service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:09.994496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1348/2661] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:09.995269 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.004511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c26f3c-5a7a-4044-b20a-ecbc06057a08 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.009186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.009773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.010049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.010321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] PATH_INFO: `/v3/projects/fe3b03d290174cc3a674a70fba4516b9/users/84a2b6d2f61e414dadc17acc5de9ab4f/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.014222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1314/2662] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:10.025928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3b03d290174cc3a674a70fba4516b9, user_id=84a2b6d2f61e414dadc17acc5de9ab4f, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.028604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.030977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:10.045626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1349/2663] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:09 2022] PUT /identity/v3/projects/fe3b03d290174cc3a674a70fba4516b9/users/84a2b6d2f61e414dadc17acc5de9ab4f/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:10.056614 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04cc22-9e61-4749-a921-5d86bca088b0 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.057034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04cc22-9e61-4749-a921-5d86bca088b0 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.057312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04cc22-9e61-4749-a921-5d86bca088b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.079420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:10.089148 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-0d04cc22-9e61-4749-a921-5d86bca088b0 None None] MFA Rules not processed for user `84a2b6d2f61e414dadc17acc5de9ab4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:10.091062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-0d04cc22-9e61-4749-a921-5d86bca088b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:10.172008 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1315/2664] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:10.178270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.246032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4764-9e65-4110-a71b-2d8878af2ef6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.250898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.251502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.251802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.252073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.252694 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.255011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.284942 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1350/2665] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:10.289124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04cc22-9e61-4749-a921-5d86bca088b0 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.300636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04cc22-9e61-4749-a921-5d86bca088b0 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.380610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.381608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.381951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.382300 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.383042 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.385081 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.411405 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1316/2666] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:10.415963 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.428276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd69aa-4271-4587-94e8-bb7a3c4e2ddf admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.434591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.435210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.435483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.435795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.436462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.438110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.453559 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1351/2667] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:10.455002 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.468461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2790a1-4a79-4ee4-a7cc-a2029740d25e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.478705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.479680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.480484 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.481264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] PATH_INFO: `/v3/projects/55556ad4151b4f3ba89d6e48dfb4a135/users/ad01cc0c820843448aa1e696a909ab04/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.499572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55556ad4151b4f3ba89d6e48dfb4a135, user_id=ad01cc0c820843448aa1e696a909ab04, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.502449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.512939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.515366 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:10.525748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1317/2668] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:10 2022] PUT /identity/v3/projects/55556ad4151b4f3ba89d6e48dfb4a135/users/ad01cc0c820843448aa1e696a909ab04/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:10.530455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.549237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002a8a3-4c84-457c-8c5a-007bba1ad670 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.609723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd09ff-2712-4479-9a23-7d4002c78cf7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.615514 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.616180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.616463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.616738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.617424 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.619046 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.621928 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.622684 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.623029 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.625184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] PATH_INFO: `/v3/projects/7011dfa8ba6a4670ac2212329705a012` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.626101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7011dfa8ba6a4670ac2212329705a012)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.628196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.631207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1318/2669] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:10.635518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.640949 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:10.647707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19a03a-d0c5-4cda-87b0-e31f19a03f95 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.653807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c1232-a9bf-401a-b8be-69a6e9a85ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.654480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1232-a9bf-401a-b8be-69a6e9a85ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.654758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1232-a9bf-401a-b8be-69a6e9a85ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.655035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1232-a9bf-401a-b8be-69a6e9a85ed2 admin admin] PATH_INFO: `/v3/projects/55556ad4151b4f3ba89d6e48dfb4a135/users/ad01cc0c820843448aa1e696a909ab04/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.657247 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c1232-a9bf-401a-b8be-69a6e9a85ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55556ad4151b4f3ba89d6e48dfb4a135, user_id=ad01cc0c820843448aa1e696a909ab04, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.659888 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c1232-a9bf-401a-b8be-69a6e9a85ed2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.671507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1319/2670] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:10 2022] PUT /identity/v3/projects/55556ad4151b4f3ba89d6e48dfb4a135/users/ad01cc0c820843448aa1e696a909ab04/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:10.712072 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7011dfa8ba6a4670ac2212329705a012', 'request_id': 'req-b1ee553e-9d89-42e1-acad-47c1c8c528e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:10.719568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7011dfa8ba6a4670ac2212329705a012', 'request_id': 'req-b1ee553e-9d89-42e1-acad-47c1c8c528e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:10.728347 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7011dfa8ba6a4670ac2212329705a012', 'request_id': 'req-b1ee553e-9d89-42e1-acad-47c1c8c528e3'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:10.742119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:10.744160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.744490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.744691 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.748219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] The token cache is being invalidate because project 7011dfa8ba6a4670ac2212329705a012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:10.749096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:10.750051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b1ee553e-9d89-42e1-acad-47c1c8c528e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:10.752171 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1352/2671] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:10 2022] DELETE /identity/v3/projects/7011dfa8ba6a4670ac2212329705a012 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:10.757004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ce87-a018-40a3-ad85-0a11d81142b3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.757712 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ce87-a018-40a3-ad85-0a11d81142b3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.759466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ce87-a018-40a3-ad85-0a11d81142b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.779971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] MFA Rules not processed for user `ad01cc0c820843448aa1e696a909ab04`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:10.781363 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:10.784719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e994ce87-a018-40a3-ad85-0a11d81142b3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:10.786783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e994ce87-a018-40a3-ad85-0a11d81142b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:10.855781 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1353/2672] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:10.864280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0d0c-6d07-4398-b379-53bbcfe3711f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.864583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0d0c-6d07-4398-b379-53bbcfe3711f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.864926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f0d0c-6d07-4398-b379-53bbcfe3711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.873940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1320/2673] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:10.883188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.885362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:10.888635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-499f0d0c-6d07-4398-b379-53bbcfe3711f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:10.889903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-499f0d0c-6d07-4398-b379-53bbcfe3711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:10.898777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1354/2674] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:10.903362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0d0c-6d07-4398-b379-53bbcfe3711f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.914248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f0d0c-6d07-4398-b379-53bbcfe3711f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.919640 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.920249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.920529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.920800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.921474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:45:10.921794 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.924678 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.936413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1355/2675] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:45:10.940661 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:10.951720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08afdd5-039f-4d7c-aeed-c152e6e8c152 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.954018 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50220dc-a22d-4f3c-ac0f-372fc692fd2a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:10.956969 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.957386 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.957766 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.958073 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.958798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:10.958945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.959335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:10.959702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:10.960039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:10.961038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.972694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:10.974260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:10.985884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1321/2676] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:10.992772 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1356/2677] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:10.996889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.009956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a70b1-6a87-462f-9559-7fda1cf5c1bf service cinder] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.063943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.081279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.082145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.082533 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.082968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.083638 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:11.085613 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:11.112244 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1322/2678] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:10 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:11.113829 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.130268 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb069a04-148f-48a0-b330-d98897aafea7 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.135680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.136770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.137167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.138277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.139918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:11.141918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:11.143566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff0a6f-d784-45f7-9660-79f21f8ae158 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.144011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:11.148394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c840002-abf6-49ba-89d5-fc23896ecc79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.149079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840002-abf6-49ba-89d5-fc23896ecc79 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.149528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840002-abf6-49ba-89d5-fc23896ecc79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.149782 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c840002-abf6-49ba-89d5-fc23896ecc79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.152225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3c840002-abf6-49ba-89d5-fc23896ecc79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:11.161899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1323/2679] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:11.163661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.187447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b2266-f9d6-4d75-bf29-db37ffb01c81 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.193160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.193871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.194223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.194565 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.195288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:11.197037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:11.213348 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1324/2680] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:11.215753 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.228605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2c052-53bc-4db7-9c8b-bd4a77adcb51 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.230240 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c840002-abf6-49ba-89d5-fc23896ecc79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:11.234486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c840002-abf6-49ba-89d5-fc23896ecc79 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:11.234735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.235487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.235860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.236200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] PATH_INFO: `/v3/projects/e76251ee49114506b023baef19ec7f64/users/d6d6ad2456264b4aa2e1e1dc738a8dd6/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.249719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1357/2681] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:11.260105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76251ee49114506b023baef19ec7f64, user_id=d6d6ad2456264b4aa2e1e1dc738a8dd6, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:11.263014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:11.290701 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1325/2682] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:11 2022] PUT /identity/v3/projects/e76251ee49114506b023baef19ec7f64/users/d6d6ad2456264b4aa2e1e1dc738a8dd6/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:11.297258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.297439 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.297703 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.320867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:11.322128 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:11.327841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:11.400655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1358/2683] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:11.410919 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.413219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:11.493312 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247cd97-12a4-4b04-941b-3c33232c7ce4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.497240 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a02a59-65bb-4938-bfca-2f0e95656698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.497973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a02a59-65bb-4938-bfca-2f0e95656698 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.498589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a02a59-65bb-4938-bfca-2f0e95656698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.498726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a02a59-65bb-4938-bfca-2f0e95656698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.510080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a02a59-65bb-4938-bfca-2f0e95656698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:11.511861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a02a59-65bb-4938-bfca-2f0e95656698 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:11.525465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1326/2684] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:11.595675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.598662 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:11.612959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b543b3e-eff3-4131-ab76-8082cf598d7a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.619937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.620777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.621271 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.621605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] PATH_INFO: `/v3/users/84a2b6d2f61e414dadc17acc5de9ab4f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.622803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a2b6d2f61e414dadc17acc5de9ab4f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:11.624839 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:11.684674 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a2b6d2f61e414dadc17acc5de9ab4f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:11.685552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a2b6d2f61e414dadc17acc5de9ab4f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:11.697028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a2b6d2f61e414dadc17acc5de9ab4f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:11.698134 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a2b6d2f61e414dadc17acc5de9ab4f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:11.710653 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a2b6d2f61e414dadc17acc5de9ab4f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:11.736592 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1359/2685] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:11 2022] DELETE /identity/v3/users/84a2b6d2f61e414dadc17acc5de9ab4f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:11.740968 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89a409-491b-46a1-bacc-6835dee8d417 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.741370 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89a409-491b-46a1-bacc-6835dee8d417 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.741465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89a409-491b-46a1-bacc-6835dee8d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:11.765289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-9a89a409-491b-46a1-bacc-6835dee8d417 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:11.766787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-9a89a409-491b-46a1-bacc-6835dee8d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:11.850786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1327/2686] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:11.869381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:11.871000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:11.986876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be3fc-a63c-4578-a083-aa43cbff8f31 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:11.997719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:11.998182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:11.998468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:11.998759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:12.025397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:12.026876 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:12.049259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1360/2687] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:12.548196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:12.548594 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:12.548956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:12.599002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:12.602148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:12.613343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] MFA Rules not processed for user `d6d6ad2456264b4aa2e1e1dc738a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:12.617635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:12.622459 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654fecb-b3cf-4561-ab5d-c612df577402 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:12.637397 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:12.638066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:12.638413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:12.638803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] PATH_INFO: `/v3/projects/fe3b03d290174cc3a674a70fba4516b9` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:12.640297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3b03d290174cc3a674a70fba4516b9)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:12.645556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:12.677528 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:12.720534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3b03d290174cc3a674a70fba4516b9', 'request_id': 'req-c8e6621d-908a-4b11-8d0d-5c9f27891132'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:12.724143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:12.728620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3b03d290174cc3a674a70fba4516b9', 'request_id': 'req-c8e6621d-908a-4b11-8d0d-5c9f27891132'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:12.753494 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3b03d290174cc3a674a70fba4516b9', 'request_id': 'req-c8e6621d-908a-4b11-8d0d-5c9f27891132'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:12.760252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1328/2688] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:12.777340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:12.780145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:12.801760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] The token cache is being invalidate because project fe3b03d290174cc3a674a70fba4516b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:12.801760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:12.804280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:12.812565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1361/2689] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:12 2022] DELETE /identity/v3/projects/fe3b03d290174cc3a674a70fba4516b9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:12.813761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:12.815246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:12.912203 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6621d-908a-4b11-8d0d-5c9f27891132 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:12.915481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b07b6-dd6e-4220-84c6-2e405a15a2d3 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:12.918790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:12.919739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:12.920037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:12.920310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] PATH_INFO: `/v3/users/ad01cc0c820843448aa1e696a909ab04` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:12.921469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad01cc0c820843448aa1e696a909ab04)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:12.923378 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:12.984126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f0e5a-e340-4e8f-a2eb-d044ccfb2798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:12.984781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0e5a-e340-4e8f-a2eb-d044ccfb2798 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:12.985068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0e5a-e340-4e8f-a2eb-d044ccfb2798 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:12.985530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0e5a-e340-4e8f-a2eb-d044ccfb2798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:12.988173 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-619f0e5a-e340-4e8f-a2eb-d044ccfb2798 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:12.998206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad01cc0c820843448aa1e696a909ab04'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:12.998981 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad01cc0c820843448aa1e696a909ab04'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.006924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad01cc0c820843448aa1e696a909ab04'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.007785 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad01cc0c820843448aa1e696a909ab04'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.020585 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad01cc0c820843448aa1e696a909ab04'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.046105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1362/2690] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:12 2022] DELETE /identity/v3/users/ad01cc0c820843448aa1e696a909ab04 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:13.055426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f0e5a-e340-4e8f-a2eb-d044ccfb2798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:13.057068 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f0e5a-e340-4e8f-a2eb-d044ccfb2798 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:13.067351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1329/2691] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:13.398148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:13.400500 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:13.463627 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:13.546418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a765369-79c2-4c65-ada0-3f3e8bec8e4b admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:13.553245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:13.553926 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:13.554283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:13.555176 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] PATH_INFO: `/v3/projects/55556ad4151b4f3ba89d6e48dfb4a135` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:13.556553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55556ad4151b4f3ba89d6e48dfb4a135)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:13.558759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:13.668354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55556ad4151b4f3ba89d6e48dfb4a135', 'request_id': 'req-776681bf-c7bc-4746-a3d3-cfc13524bb37'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.676951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55556ad4151b4f3ba89d6e48dfb4a135', 'request_id': 'req-776681bf-c7bc-4746-a3d3-cfc13524bb37'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.685002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55556ad4151b4f3ba89d6e48dfb4a135', 'request_id': 'req-776681bf-c7bc-4746-a3d3-cfc13524bb37'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.701456 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] The token cache is being invalidate because project 55556ad4151b4f3ba89d6e48dfb4a135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:13.702104 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.703116 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-776681bf-c7bc-4746-a3d3-cfc13524bb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:13.705742 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1363/2692] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:13 2022] DELETE /identity/v3/projects/55556ad4151b4f3ba89d6e48dfb4a135 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:13.711636 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386535-d271-458f-aa3b-614b6adee090 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:13.712053 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386535-d271-458f-aa3b-614b6adee090 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:13.712433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9386535-d271-458f-aa3b-614b6adee090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:13.735941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-b9386535-d271-458f-aa3b-614b6adee090 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:13.737463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b9386535-d271-458f-aa3b-614b6adee090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:13.810482 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1330/2693] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:13.818867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e721c66-5f0b-4776-8ed7-58d4981f96d6 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:13.819412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e721c66-5f0b-4776-8ed7-58d4981f96d6 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:13.824099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e721c66-5f0b-4776-8ed7-58d4981f96d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:13.851324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-9e721c66-5f0b-4776-8ed7-58d4981f96d6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:13.852672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9e721c66-5f0b-4776-8ed7-58d4981f96d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:13.864779 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1364/2694] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:13.867770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386535-d271-458f-aa3b-614b6adee090 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:13.874626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:13.879451 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9386535-d271-458f-aa3b-614b6adee090 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:13.889659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:13.889912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:13.890897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:13.891350 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:13.892228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81534) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:45:13.892602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:13.895258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:13.915223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1331/2695] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:45:13.919732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e721c66-5f0b-4776-8ed7-58d4981f96d6 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:13.930388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e721c66-5f0b-4776-8ed7-58d4981f96d6 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:13.935458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:13.936096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:13.936488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:13.936624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:13.937249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:13.939151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:13.968844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1365/2696] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:13 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:13.974192 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:13.986193 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cf1c9-f12e-4835-a4ec-afb7f821cc82 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:13.999071 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.001699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.063118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.063705 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.063985 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.064325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.065075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.071522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.083940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386500-f036-4efc-8493-314bf2dceffe admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.089519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.090121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.090400 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.090800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.092916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.097087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1332/2697] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:13 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:45:14.097763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.099291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.109574 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.111209 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.111599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc186f0-3a7a-4bf3-ba29-18033ff30e77 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.116437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.117093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.117388 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.117639 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] PATH_INFO: `/v3/users/17fdb3fb9bb04c21ba95096f1bd6e6ee` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.118763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fdb3fb9bb04c21ba95096f1bd6e6ee)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.120741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.122418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1366/2698] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:14.123158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.134191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b38fc0-d7ec-410b-8059-2a64cf2fcafb service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.143600 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.144232 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.144629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.145007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.145666 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.147803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.160719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1367/2699] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:14.164761 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.178091 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fdb3fb9bb04c21ba95096f1bd6e6ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.180052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88fa06-9219-4f04-b911-b222414b5c84 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.185677 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fdb3fb9bb04c21ba95096f1bd6e6ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.186048 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.186671 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.186951 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.187221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.187918 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.189541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.192532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:14.199404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fdb3fb9bb04c21ba95096f1bd6e6ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.203308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1368/2700] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:14.208438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.210572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fdb3fb9bb04c21ba95096f1bd6e6ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.211211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-d0f32f40-2a72-4394-895c-fac3a5e51a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fdb3fb9bb04c21ba95096f1bd6e6ee'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.217763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1333/2701] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:45:14 2022] DELETE /identity/v3/users/17fdb3fb9bb04c21ba95096f1bd6e6ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:14.220288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ae8ea-3339-42b5-9a4f-3c2563ccdae8 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.282248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.282934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.283249 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.283522 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] PATH_INFO: `/v3/projects/f62a8f29b4fe49f88d816788507cf0eb/users/ba5fbe65692d4ae2a102e660d6fc32b1/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.298497 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62a8f29b4fe49f88d816788507cf0eb, user_id=ba5fbe65692d4ae2a102e660d6fc32b1, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.301300 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.318279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1369/2702] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:14 2022] PUT /identity/v3/projects/f62a8f29b4fe49f88d816788507cf0eb/users/ba5fbe65692d4ae2a102e660d6fc32b1/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:14.323724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.324083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.324275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.344107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:14.345368 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.397795 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:14.409645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.412086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.415325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1334/2703] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:45:14.426945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.428773 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.430290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dfcb7-1b51-4f0f-81fc-a23db281b63c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.435749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.436488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.437479 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.437758 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] PATH_INFO: `/v3/projects/82675a2298424f038ca2cc43f2df1f1a` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.439098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82675a2298424f038ca2cc43f2df1f1a)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.441337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.494860 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82675a2298424f038ca2cc43f2df1f1a', 'request_id': 'req-b7e75fea-deae-49b8-87fc-674e836bcda0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.498716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801a94-3654-4233-8473-5ce90a93f828 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.502569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82675a2298424f038ca2cc43f2df1f1a', 'request_id': 'req-b7e75fea-deae-49b8-87fc-674e836bcda0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.510151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82675a2298424f038ca2cc43f2df1f1a', 'request_id': 'req-b7e75fea-deae-49b8-87fc-674e836bcda0'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.526591 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] The token cache is being invalidate because project 82675a2298424f038ca2cc43f2df1f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:45:14.526882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.527567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-b7e75fea-deae-49b8-87fc-674e836bcda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:45:14.529354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1370/2704] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:45:14 2022] DELETE /identity/v3/projects/82675a2298424f038ca2cc43f2df1f1a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:45:14.530635 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267478-9c0a-4469-8b95-8e3cf5e43aba None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.530916 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267478-9c0a-4469-8b95-8e3cf5e43aba None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.531187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267478-9c0a-4469-8b95-8e3cf5e43aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.550471 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c1267478-9c0a-4469-8b95-8e3cf5e43aba None None] MFA Rules not processed for user `d6d6ad2456264b4aa2e1e1dc738a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:14.552182 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c1267478-9c0a-4469-8b95-8e3cf5e43aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.556435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d510a83-18af-41fa-94bc-62ac5366a276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.557059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d510a83-18af-41fa-94bc-62ac5366a276 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.557338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d510a83-18af-41fa-94bc-62ac5366a276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.557605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d510a83-18af-41fa-94bc-62ac5366a276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.559603 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-7d510a83-18af-41fa-94bc-62ac5366a276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.618801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1371/2705] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:14.620408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a1be-04fa-4fd7-aa84-21fe5ef42295 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.620695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a1be-04fa-4fd7-aa84-21fe5ef42295 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.620968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a1be-04fa-4fd7-aa84-21fe5ef42295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.626396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d510a83-18af-41fa-94bc-62ac5366a276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.628138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d510a83-18af-41fa-94bc-62ac5366a276 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.639212 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1335/2706] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:14.642234 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-ccd5a1be-04fa-4fd7-aa84-21fe5ef42295 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:14.644039 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ccd5a1be-04fa-4fd7-aa84-21fe5ef42295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.654276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1372/2707] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:14.662909 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47525b-ca1e-4239-ac92-2b3de5878141 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.663255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47525b-ca1e-4239-ac92-2b3de5878141 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.663915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47525b-ca1e-4239-ac92-2b3de5878141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.686876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ee47525b-ca1e-4239-ac92-2b3de5878141 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:14.688093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ee47525b-ca1e-4239-ac92-2b3de5878141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.697450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1336/2708] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:14.701826 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a1be-04fa-4fd7-aa84-21fe5ef42295 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.707832 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:14.714469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a1be-04fa-4fd7-aa84-21fe5ef42295 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.721903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.727780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.727780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.727780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.729134 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:45:14.729558 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.732567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.752517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1373/2709] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:45:14.757903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47525b-ca1e-4239-ac92-2b3de5878141 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.768771 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47525b-ca1e-4239-ac92-2b3de5878141 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.774926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.775661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.776074 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.776459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.777398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.779783 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.823266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1337/2710] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:14 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:14.828105 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.841568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945ef26-1ca3-4fa2-bad8-795996c6512e admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.914731 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.916823 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:14.920983 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.921603 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.921878 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.922830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.923633 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.926562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.951987 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1374/2711] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:14 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:14.955890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.962961 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:14.966723 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb706-a4d9-4ed5-8061-09223ba6f498 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:14.974046 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:14.974932 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:14.975263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:14.976076 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:14.976253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:14.978979 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:14.994274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1375/2712] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:14.994508 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:14.999787 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ad43f-ae0c-4a5b-824f-0e19517d3935 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:15.003466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797b698-0ae5-4813-916d-2fe7097bba99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:15.004140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b698-0ae5-4813-916d-2fe7097bba99 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:15.004415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b698-0ae5-4813-916d-2fe7097bba99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:15.004842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b698-0ae5-4813-916d-2fe7097bba99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:15.006797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-5797b698-0ae5-4813-916d-2fe7097bba99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:15.010111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab06d1-87b6-4ab1-8398-2888bb8f326f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:15.017599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:15.017805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797b698-0ae5-4813-916d-2fe7097bba99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:15.018967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:15.019428 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:15.019805 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797b698-0ae5-4813-916d-2fe7097bba99 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:15.020517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:15.020873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:15.022720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:15.038041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1376/2713] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:15.038311 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1338/2714] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:15.039264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:15.049643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e06b-d583-4bfb-a886-b0f635996664 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:15.054920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:15.055602 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:15.055887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:15.056309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] PATH_INFO: `/v3/projects/e6a679b7c521489684c602823030ff4b/users/109614e279ad4057a5908636e6c21a3e/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:15.074731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a679b7c521489684c602823030ff4b, user_id=109614e279ad4057a5908636e6c21a3e, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:15.077527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:15.094053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1377/2715] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:15 2022] PUT /identity/v3/projects/e6a679b7c521489684c602823030ff4b/users/109614e279ad4057a5908636e6c21a3e/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:15.099342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:15.099973 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:15.100187 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:15.120555 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:15.122498 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:15.188490 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1339/2716] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:15.198261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:15.200388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:15.261708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f8554-be98-472c-a33c-2bf8f88aee10 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:15.265759 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:15.266403 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:15.266685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:15.266957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:15.278079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:15.279622 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:15.290977 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1378/2717] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:15.828504 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:15.831313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:15.912014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81164dbd-0113-40db-8c57-ce65ec1dcd76 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:15.922403 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cf031-5415-4130-b50a-f4eb43c9907d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:15.923048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf031-5415-4130-b50a-f4eb43c9907d service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:15.923337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf031-5415-4130-b50a-f4eb43c9907d service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:15.923635 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cf031-5415-4130-b50a-f4eb43c9907d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:15.925800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c37cf031-5415-4130-b50a-f4eb43c9907d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:15.938229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cf031-5415-4130-b50a-f4eb43c9907d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:15.940075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cf031-5415-4130-b50a-f4eb43c9907d service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:15.953226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1340/2718] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:18.847320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:18.865172 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf71e-4aa5-47fd-a7d8-4ebbc15c7069 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:18.880581 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:18.881114 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:18.881488 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:18.882122 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:18.886098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:18.915509 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:18.918430 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:18.939634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1379/2719] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:20.795447 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb92e5-6887-472d-8503-ce250cbfb4a4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:20.798062 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb92e5-6887-472d-8503-ce250cbfb4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:20.798849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb92e5-6887-472d-8503-ce250cbfb4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:20.850486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c6eb92e5-6887-472d-8503-ce250cbfb4a4 None None] MFA Rules not processed for user `ba5fbe65692d4ae2a102e660d6fc32b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:20.852804 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c6eb92e5-6887-472d-8503-ce250cbfb4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:20.926583 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:20.942724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1341/2720] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:20.948157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:20.949970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:21.001434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469ac5f-3fd5-42da-85af-9c8e0143aadc service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:21.009868 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:21.010491 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:21.010948 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:21.011084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:21.011721 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:21.014078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:21.052873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:21.067775 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1380/2721] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:45:20 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:21.075688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb92e5-6887-472d-8503-ce250cbfb4a4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:21.098439 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb92e5-6887-472d-8503-ce250cbfb4a4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:21.266339 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:21.266978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:21.267258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:21.267529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] PATH_INFO: `/v3/users` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:21.268512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:21.275532 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:21.345648 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1342/2722] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:45:21 2022] POST /identity/v3/users => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:45:21.350748 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:21.373012 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28130198-51ce-4b57-a2b5-10e5b22314e7 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:21.393696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:21.394337 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:21.394855 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:21.395083 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:21.396476 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:21.398145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:21.437673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1381/2723] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:45:21.439269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:21.457634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8d474-0420-4ea0-b3d8-b23db0e0f87d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:21.468100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:21.468892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:21.469245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:21.469589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] PATH_INFO: `/v3/projects/9e234d8c5d2b41fdb36a7d83c7bfb0b1/users/abe6f7132870448b897b20c28c7a1ad8/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:21.515233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e234d8c5d2b41fdb36a7d83c7bfb0b1, user_id=abe6f7132870448b897b20c28c7a1ad8, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:21.519120 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:21.543228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1343/2724] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:21 2022] PUT /identity/v3/projects/9e234d8c5d2b41fdb36a7d83c7bfb0b1/users/abe6f7132870448b897b20c28c7a1ad8/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:21.546801 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:21.559485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa145f0-78b5-4966-9b9a-cc3b0b59a6cd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:21.696698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81947c72-2347-4c39-bf2d-dee2490eea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:21.697784 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947c72-2347-4c39-bf2d-dee2490eea9c admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:21.698252 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947c72-2347-4c39-bf2d-dee2490eea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:21.698606 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947c72-2347-4c39-bf2d-dee2490eea9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:21.699629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81947c72-2347-4c39-bf2d-dee2490eea9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:21.724361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81947c72-2347-4c39-bf2d-dee2490eea9c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:21.747628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1382/2725] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:45:21.752024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:21.765174 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83595f-14b4-49c3-89f1-6bab2702b21d admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:21.770870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:21.771621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:21.771882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:21.772161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] PATH_INFO: `/v3/projects/9e234d8c5d2b41fdb36a7d83c7bfb0b1/users/abe6f7132870448b897b20c28c7a1ad8/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:21.774318 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e234d8c5d2b41fdb36a7d83c7bfb0b1, user_id=abe6f7132870448b897b20c28c7a1ad8, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:21.778223 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:21.800340 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1344/2726] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:45:21 2022] PUT /identity/v3/projects/9e234d8c5d2b41fdb36a7d83c7bfb0b1/users/abe6f7132870448b897b20c28c7a1ad8/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:45:23.355996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024fcbb-a897-4682-8515-2064a14c561f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:23.357617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024fcbb-a897-4682-8515-2064a14c561f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:23.358045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024fcbb-a897-4682-8515-2064a14c561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:23.414807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a024fcbb-a897-4682-8515-2064a14c561f None None] MFA Rules not processed for user `109614e279ad4057a5908636e6c21a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:23.416412 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a024fcbb-a897-4682-8515-2064a14c561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:23.552651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1383/2727] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:23.567034 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:23.568930 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:23.664875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd3b0-d1d8-42b9-8f30-41f110e02fb4 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:23.688702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:23.689653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:23.689791 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:23.690007 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:23.700606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:23.703347 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:23.731849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1345/2728] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:25.989920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8aba71-bd83-479b-a69b-37b59ed29e72 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:25.990413 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8aba71-bd83-479b-a69b-37b59ed29e72 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:25.990738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8aba71-bd83-479b-a69b-37b59ed29e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:26.064576 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-2b8aba71-bd83-479b-a69b-37b59ed29e72 None None] MFA Rules not processed for user `109614e279ad4057a5908636e6c21a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:26.067995 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-2b8aba71-bd83-479b-a69b-37b59ed29e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:26.093658 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1384/2729] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:29.176335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:29.194515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eba52-2060-4d23-a693-1e4b295bdf8e service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:29.205228 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:29.206906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:29.207619 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:29.208226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:29.210871 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:29.228608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:29.230468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:29.245899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1346/2730] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:29.254189 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156493-2f5d-40b7-b62f-aa09fef61798 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:29.255159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156493-2f5d-40b7-b62f-aa09fef61798 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:29.255664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156493-2f5d-40b7-b62f-aa09fef61798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:29.345831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-fa156493-2f5d-40b7-b62f-aa09fef61798 None None] MFA Rules not processed for user `abe6f7132870448b897b20c28c7a1ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:29.348038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-fa156493-2f5d-40b7-b62f-aa09fef61798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:29.484962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:29.506294 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1385/2731] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:29.520404 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:29.522408 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:29.554563 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:29.606332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5742d-313f-4f7d-abd2-ef90d7762cf4 service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:29.610492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0a331472a0040d68824a2245bf3e716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:29.611315 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:29.611774 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:29.612214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:29.678806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:29.680708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:29.690302 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1347/2732] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:45:29.851690 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c62d-10e2-4bbf-b467-bf0044170d9c None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:29.854850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c62d-10e2-4bbf-b467-bf0044170d9c None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:29.855364 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c62d-10e2-4bbf-b467-bf0044170d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:29.880022 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-d781c62d-10e2-4bbf-b467-bf0044170d9c None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:29.881533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d781c62d-10e2-4bbf-b467-bf0044170d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:29.982773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1386/2733] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:30.056371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:30.058307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:30.192430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab0c0e-7011-42d7-987c-f32f7cf4ec0e service glance] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:30.204210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13732e3c-6de8-4adc-9f2d-b9323c631013 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:30.205167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13732e3c-6de8-4adc-9f2d-b9323c631013 service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:30.205599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13732e3c-6de8-4adc-9f2d-b9323c631013 service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:30.206019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13732e3c-6de8-4adc-9f2d-b9323c631013 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:30.221161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13732e3c-6de8-4adc-9f2d-b9323c631013 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:30.223821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13732e3c-6de8-4adc-9f2d-b9323c631013 service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:30.258547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1348/2734] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:45:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:45:36.664330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14da8b-93e6-4e18-92e5-3ee5ca47a4b0 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:36.664904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14da8b-93e6-4e18-92e5-3ee5ca47a4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:36.664904 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14da8b-93e6-4e18-92e5-3ee5ca47a4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:36.691920 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cf14da8b-93e6-4e18-92e5-3ee5ca47a4b0 None None] MFA Rules not processed for user `d6d6ad2456264b4aa2e1e1dc738a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:36.693351 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cf14da8b-93e6-4e18-92e5-3ee5ca47a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:36.773859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1387/2735] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:40.242723 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=72 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:40.643572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937d37-f210-49e0-8d52-7c03c47dac7e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:40.643862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937d37-f210-49e0-8d52-7c03c47dac7e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:40.644475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937d37-f210-49e0-8d52-7c03c47dac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:40.669963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c2937d37-f210-49e0-8d52-7c03c47dac7e None None] MFA Rules not processed for user `ba5fbe65692d4ae2a102e660d6fc32b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:40.671227 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c2937d37-f210-49e0-8d52-7c03c47dac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:40.679995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1349/2736] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:45:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:41.072319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14da8b-93e6-4e18-92e5-3ee5ca47a4b0 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:41.131371 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14da8b-93e6-4e18-92e5-3ee5ca47a4b0 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:41.135178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:41.135858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:41.136102 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:41.136369 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:41.138427 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:41.148502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:41.149934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:41.158024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1388/2737] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:43.436905 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:43.437387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:43.437511 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:43.457936 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:45:43.459089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:43.466732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1350/2738] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:45:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:45:43.479490 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:43.492539 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610bafd-7990-4c60-9f2d-925f258fc762 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:43.497756 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b893ae-de61-4642-a804-e118e18eb37f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:43.498541 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b893ae-de61-4642-a804-e118e18eb37f service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:43.498884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b893ae-de61-4642-a804-e118e18eb37f service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:43.499220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b893ae-de61-4642-a804-e118e18eb37f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:43.507732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b893ae-de61-4642-a804-e118e18eb37f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:43.509573 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b893ae-de61-4642-a804-e118e18eb37f service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:43.518096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1389/2739] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:45:45.852232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:45:45.853732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:45.871375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd0dc-037a-4930-90d8-2a4f82e6c807 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:45:45.879277 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:45:45.880524 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:45:45.880987 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:45:45.881460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:45:45.883561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:45:45.898381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:45:45.900367 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:45:45.912443 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1351/2740] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:45:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:45:53.514605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=85 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:45:55.907264 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=12 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:01.029549 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988710a9-b3ee-4183-ad10-0c61763edd5e None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:01.030052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988710a9-b3ee-4183-ad10-0c61763edd5e None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:01.030052 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988710a9-b3ee-4183-ad10-0c61763edd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:01.054293 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-988710a9-b3ee-4183-ad10-0c61763edd5e None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:01.056450 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-988710a9-b3ee-4183-ad10-0c61763edd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:01.065519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1390/2741] 10.222.0.88 () {58 vars in 1009 bytes} [Wed Aug 24 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:01.078433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:01.090257 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce732ab-731f-483d-8f62-312214929b1f service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:01.096508 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:01.097140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:01.097440 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:01.097707 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:01.106900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:01.108623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:01.117381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1352/2742] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:46:07.575620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988710a9-b3ee-4183-ad10-0c61763edd5e None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:07.593280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988710a9-b3ee-4183-ad10-0c61763edd5e None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:07.597949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:07.599518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:07.600313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:07.601142 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:07.624813 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:07.626632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:07.672572 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1391/2743] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:46:11.113747 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=6 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:15.023373 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:15.026472 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:15.145575 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247713a8-9bf1-4c01-9907-3d4e024605dd service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:15.155177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:15.156437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:15.157775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:15.158980 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] PATH_INFO: `/v3/users/94dd7e27d6c64f849a1efb3d32dc4fa4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:15.161496 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dd7e27d6c64f849a1efb3d32dc4fa4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:15.165006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:15.262158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dd7e27d6c64f849a1efb3d32dc4fa4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:15.273853 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dd7e27d6c64f849a1efb3d32dc4fa4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:15.293384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dd7e27d6c64f849a1efb3d32dc4fa4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:15.305732 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dd7e27d6c64f849a1efb3d32dc4fa4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:15.311559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dd7e27d6c64f849a1efb3d32dc4fa4'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:15.321929 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1353/2744] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:46:15 2022] DELETE /identity/v3/users/94dd7e27d6c64f849a1efb3d32dc4fa4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:15.332739 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:15.363319 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81547e-793e-4fcd-bbed-908c7054d7e0 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:15.479849 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:15.480685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:15.481120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:15.482087 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:15.484765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:15.659009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:15.660463 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:15.677517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1392/2745] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:46:15.920203 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:15.922763 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:15.966976 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbd00e-8e2b-45e5-9ee7-13e8dbd237a8 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:15.982808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:15.983471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:15.983772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:15.984100 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] PATH_INFO: `/v3/projects/e5fcb2a0adcd41649faac787794d4812` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:15.985372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5fcb2a0adcd41649faac787794d4812)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:15.987293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:16.064623 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5fcb2a0adcd41649faac787794d4812', 'request_id': 'req-b824cd3c-4ffa-48a5-9948-1859b06617d5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.076115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5fcb2a0adcd41649faac787794d4812', 'request_id': 'req-b824cd3c-4ffa-48a5-9948-1859b06617d5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.084494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5fcb2a0adcd41649faac787794d4812', 'request_id': 'req-b824cd3c-4ffa-48a5-9948-1859b06617d5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.097149 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] The token cache is being invalidate because project e5fcb2a0adcd41649faac787794d4812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:46:16.097475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.098245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.100415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1354/2746] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:46:15 2022] DELETE /identity/v3/projects/e5fcb2a0adcd41649faac787794d4812 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:16.104466 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:16.116457 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3538c-df58-435f-980a-91b927d7eff5 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:16.189657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:16.190328 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:16.190610 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:16.191005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] PATH_INFO: `/v3/users/873dd06cba5241c58f58be1052d53b42` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:16.192675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=873dd06cba5241c58f58be1052d53b42)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:16.194656 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:16.249829 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:16.265159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873dd06cba5241c58f58be1052d53b42'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.265830 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873dd06cba5241c58f58be1052d53b42'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.275419 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873dd06cba5241c58f58be1052d53b42'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.276477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873dd06cba5241c58f58be1052d53b42'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.286551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-84216806-847e-422e-bdcf-4fb1756096ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873dd06cba5241c58f58be1052d53b42'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.335527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1393/2747] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:46:16 2022] DELETE /identity/v3/users/873dd06cba5241c58f58be1052d53b42 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:16.536089 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:16.537832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:16.548092 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:16.562495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824cd3c-4ffa-48a5-9948-1859b06617d5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:16.646906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:16.647550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:16.647862 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:16.648137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] PATH_INFO: `/v3/projects/e8481c01807d4717ac836d0a6742e6d4` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:16.649461 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8481c01807d4717ac836d0a6742e6d4)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:16.651375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:16.718079 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8481c01807d4717ac836d0a6742e6d4', 'request_id': 'req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.726694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8481c01807d4717ac836d0a6742e6d4', 'request_id': 'req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.734501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8481c01807d4717ac836d0a6742e6d4', 'request_id': 'req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.748641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] The token cache is being invalidate because project e8481c01807d4717ac836d0a6742e6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:46:16.749137 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.749819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:16.751765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1355/2748] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:46:16 2022] DELETE /identity/v3/projects/e8481c01807d4717ac836d0a6742e6d4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:19.912594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:19.913096 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:19.913207 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:19.933408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:19.934626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:19.993254 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1394/2749] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 16:46:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:20.006894 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:20.008851 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:20.082245 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae62c6e-ea79-4c4a-855f-43d8172c5af5 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:20.088478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:20.089102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:20.089385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:20.089657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:20.098267 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:20.099904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:20.108425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1356/2750] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:46:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:46:22.109018 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:22.110620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:22.188778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1edf9-4c95-4a09-8f77-23c9b4925f2b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:22.193589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:22.194222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:22.194496 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:22.194769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] PATH_INFO: `/v3/users/d6d6ad2456264b4aa2e1e1dc738a8dd6` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:22.196084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d6ad2456264b4aa2e1e1dc738a8dd6)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:22.198023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:22.248307 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d6ad2456264b4aa2e1e1dc738a8dd6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.248971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d6ad2456264b4aa2e1e1dc738a8dd6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.256251 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d6ad2456264b4aa2e1e1dc738a8dd6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.256894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d6ad2456264b4aa2e1e1dc738a8dd6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.258751 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:22.266408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-25bfbab8-ef8a-45e6-94c4-b99673046860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d6ad2456264b4aa2e1e1dc738a8dd6'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.285593 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1395/2751] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:46:22 2022] DELETE /identity/v3/users/d6d6ad2456264b4aa2e1e1dc738a8dd6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:22.482147 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:22.498576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5fb76-0992-4788-a2e7-0f9c7c1f7e3e service swift] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:22.518214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:22.558803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:22.559431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:22.559806 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:22.560078 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] PATH_INFO: `/v3/projects/e76251ee49114506b023baef19ec7f64` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:22.561283 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76251ee49114506b023baef19ec7f64)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:22.563199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:22.613105 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76251ee49114506b023baef19ec7f64', 'request_id': 'req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.621466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76251ee49114506b023baef19ec7f64', 'request_id': 'req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.627912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76251ee49114506b023baef19ec7f64', 'request_id': 'req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.639349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] The token cache is being invalidate because project e76251ee49114506b023baef19ec7f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:46:22.639660 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.640352 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-0f560f94-54f8-4b8e-8ce2-ecb7e272fdff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:22.641956 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1357/2752] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:46:22 2022] DELETE /identity/v3/projects/e76251ee49114506b023baef19ec7f64 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:22.647320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c66e82-7efa-4a77-b8a9-a400b01bb28f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:22.647681 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c66e82-7efa-4a77-b8a9-a400b01bb28f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:22.647988 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c66e82-7efa-4a77-b8a9-a400b01bb28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:22.669310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-a6c66e82-7efa-4a77-b8a9-a400b01bb28f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:22.670527 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-a6c66e82-7efa-4a77-b8a9-a400b01bb28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:22.733009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1396/2753] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:22.741846 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ef6b-b7bb-4005-91b2-a6e3e46f9b37 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:22.742145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ef6b-b7bb-4005-91b2-a6e3e46f9b37 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:22.742426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ef6b-b7bb-4005-91b2-a6e3e46f9b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:22.766307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-bd98ef6b-b7bb-4005-91b2-a6e3e46f9b37 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:22.768204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-bd98ef6b-b7bb-4005-91b2-a6e3e46f9b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:22.782246 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1358/2754] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:22.788034 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c66e82-7efa-4a77-b8a9-a400b01bb28f None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:22.798215 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c66e82-7efa-4a77-b8a9-a400b01bb28f None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:22.803568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:22.804192 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:22.804468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:22.804760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:22.805521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:46:22.805824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:22.807422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:22.819067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1397/2755] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:46:22.823982 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ef6b-b7bb-4005-91b2-a6e3e46f9b37 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:22.833821 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ef6b-b7bb-4005-91b2-a6e3e46f9b37 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:22.839107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:22.839749 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:22.840023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:22.840293 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:22.840957 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:22.842858 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:22.875550 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1359/2756] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:46:22 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:46:22.880057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:22.890845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af377f-ccd8-48e7-8acb-8d0176351dab admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:22.947891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:22.948486 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:22.948773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:22.949047 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:22.949664 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:22.951586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:22.973587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1398/2757] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:46:22 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:46:23.036127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:23.046841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dd73c-d2cc-450b-a875-b41b5997e5fc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:23.051816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:23.052430 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:23.052706 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:23.052974 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:23.053634 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:23.055255 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:23.066136 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1360/2758] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:46:23.070547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:23.081657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ca8d-f043-4e95-9273-73cf44d304df admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:23.086901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2959efb-d1de-4ffe-8713-6fdb27e40cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:23.087469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959efb-d1de-4ffe-8713-6fdb27e40cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:23.087795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959efb-d1de-4ffe-8713-6fdb27e40cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:23.088065 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959efb-d1de-4ffe-8713-6fdb27e40cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:23.088707 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2959efb-d1de-4ffe-8713-6fdb27e40cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:23.090380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2959efb-d1de-4ffe-8713-6fdb27e40cc5 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:23.100768 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1399/2759] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:46:23.105495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:23.116080 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ce2e-1e95-4197-bda4-6a8b973a16a3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:23.122067 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:23.122712 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:23.122994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:23.123263 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] PATH_INFO: `/v3/projects/2c14c9fca3d84e8d97979e777f46d006/users/ee39b7d09d364a7484916d7cbd70864f/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:23.139410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c14c9fca3d84e8d97979e777f46d006, user_id=ee39b7d09d364a7484916d7cbd70864f, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:23.142107 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:23.161540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1361/2760] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:46:23 2022] PUT /identity/v3/projects/2c14c9fca3d84e8d97979e777f46d006/users/ee39b7d09d364a7484916d7cbd70864f/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:23.175954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8c25-df52-4c1a-87a6-7b78771356b3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:23.176477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8c25-df52-4c1a-87a6-7b78771356b3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:23.176477 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a8c25-df52-4c1a-87a6-7b78771356b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:23.207726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-468a8c25-df52-4c1a-87a6-7b78771356b3 None None] MFA Rules not processed for user `ee39b7d09d364a7484916d7cbd70864f`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:23.208929 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-468a8c25-df52-4c1a-87a6-7b78771356b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:23.245224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:23.284100 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1400/2761] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:23.296214 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:23.298082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:23.355353 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:23.359979 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b813a-ac50-45d3-9c4f-6f96f9f598c2 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:23.364525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3850f-9aa4-43a1-80f6-45d1c867257d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:23.365145 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3850f-9aa4-43a1-80f6-45d1c867257d service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:23.365781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3850f-9aa4-43a1-80f6-45d1c867257d service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:23.366210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3850f-9aa4-43a1-80f6-45d1c867257d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:23.376146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3850f-9aa4-43a1-80f6-45d1c867257d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:23.377589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3850f-9aa4-43a1-80f6-45d1c867257d service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:23.386975 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1362/2762] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:46:25.974044 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8c25-df52-4c1a-87a6-7b78771356b3 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:26.040966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a8c25-df52-4c1a-87a6-7b78771356b3 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:26.046265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:26.046890 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:26.047193 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:26.047434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] PATH_INFO: `/v3/users/ee39b7d09d364a7484916d7cbd70864f` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:26.048639 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee39b7d09d364a7484916d7cbd70864f)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:26.050569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:26.100160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee39b7d09d364a7484916d7cbd70864f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.100821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee39b7d09d364a7484916d7cbd70864f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.107914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee39b7d09d364a7484916d7cbd70864f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.108544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee39b7d09d364a7484916d7cbd70864f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.117090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee39b7d09d364a7484916d7cbd70864f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.134984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1401/2763] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:46:25 2022] DELETE /identity/v3/users/ee39b7d09d364a7484916d7cbd70864f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:26.139758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:26.140252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:26.140349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:26.161308 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:26.162522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:26.232452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1363/2764] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:46:26.242446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:26.244353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:26.300873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:26.304755 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4f727-4468-4a16-b20f-cb2c73ca4f32 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:26.309135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a1b3b-8451-4804-9379-331a2c007e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:26.309719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1b3b-8451-4804-9379-331a2c007e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:26.310032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1b3b-8451-4804-9379-331a2c007e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:26.310374 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1b3b-8451-4804-9379-331a2c007e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:26.322326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a1b3b-8451-4804-9379-331a2c007e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:26.323844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a1b3b-8451-4804-9379-331a2c007e14 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:26.333675 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1402/2765] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:46:26.617503 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:26.619085 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:26.637917 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515409d-03b7-431d-9db2-deb9aa8ce14b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:26.643279 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:26.645093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:26.645606 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:26.646291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] PATH_INFO: `/v3/projects/2c14c9fca3d84e8d97979e777f46d006` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:26.648600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c14c9fca3d84e8d97979e777f46d006)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:26.651019 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:26.717724 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c14c9fca3d84e8d97979e777f46d006', 'request_id': 'req-4182adff-b67f-44ba-a86e-6514d71cf79c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.727011 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c14c9fca3d84e8d97979e777f46d006', 'request_id': 'req-4182adff-b67f-44ba-a86e-6514d71cf79c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.736735 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c14c9fca3d84e8d97979e777f46d006', 'request_id': 'req-4182adff-b67f-44ba-a86e-6514d71cf79c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.751165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] The token cache is being invalidate because project 2c14c9fca3d84e8d97979e777f46d006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:46:26.751464 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.752218 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-4182adff-b67f-44ba-a86e-6514d71cf79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:26.754076 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1364/2766] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:46:26 2022] DELETE /identity/v3/projects/2c14c9fca3d84e8d97979e777f46d006 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:26.758917 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041384-3e11-47f6-9b85-9be87711338d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:26.759266 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041384-3e11-47f6-9b85-9be87711338d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:26.759620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041384-3e11-47f6-9b85-9be87711338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:26.781809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-94041384-3e11-47f6-9b85-9be87711338d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:26.783090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-94041384-3e11-47f6-9b85-9be87711338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:26.860532 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1403/2767] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:26.867878 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63a2f-de48-4e7d-9365-9f5aba0d20d6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:26.868200 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63a2f-de48-4e7d-9365-9f5aba0d20d6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:26.869286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f63a2f-de48-4e7d-9365-9f5aba0d20d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:26.910235 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e5f63a2f-de48-4e7d-9365-9f5aba0d20d6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:26.912507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e5f63a2f-de48-4e7d-9365-9f5aba0d20d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:26.931494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1365/2768] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:26.936120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041384-3e11-47f6-9b85-9be87711338d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:26.953055 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041384-3e11-47f6-9b85-9be87711338d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:26.960857 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:26.961965 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:26.962452 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:26.962934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:26.964184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:46:26.964736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:26.967844 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:26.981869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1404/2769] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:46:26.985841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f63a2f-de48-4e7d-9365-9f5aba0d20d6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:26.995867 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f63a2f-de48-4e7d-9365-9f5aba0d20d6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:27.000785 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:27.001394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:27.001669 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:27.001937 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:27.002576 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:27.004526 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:27.037376 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1366/2770] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:46:26 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:46:27.038924 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:27.049391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b86a9-2c94-4dc3-b25e-a0592c568aed admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:27.109184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:27.109798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:27.110074 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:27.110353 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:27.110967 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:27.112896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:27.136749 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1405/2771] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:46:27 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:46:27.141134 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:27.152391 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4627-beb3-4cc9-a8cc-72f4ab7ed97f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:27.157807 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:27.158421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:27.158695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:27.158954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:27.159610 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:27.161207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:27.172108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1367/2772] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:46:27.176205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:27.186803 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff951942-f046-4686-96b2-be6791ee4434 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:27.191819 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4bafd-838c-4ab6-9af6-899a34537909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:27.192505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4bafd-838c-4ab6-9af6-899a34537909 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:27.192874 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4bafd-838c-4ab6-9af6-899a34537909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:27.193148 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4bafd-838c-4ab6-9af6-899a34537909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:27.193795 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4bafd-838c-4ab6-9af6-899a34537909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:27.195421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4bafd-838c-4ab6-9af6-899a34537909 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:27.206362 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1406/2773] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:46:27.210618 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:27.221475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dddfc8-47b6-4659-8000-5cdc699f4d4e admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:27.226266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038034-855b-411e-964c-889142478bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:27.227073 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038034-855b-411e-964c-889142478bac admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:27.227360 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038034-855b-411e-964c-889142478bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:27.227661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038034-855b-411e-964c-889142478bac admin admin] PATH_INFO: `/v3/projects/d0caff361d864a2c8f8e65cb2efae05a/users/857ef5e1c285487ea0581440e158cfe8/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:27.243934 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038034-855b-411e-964c-889142478bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0caff361d864a2c8f8e65cb2efae05a, user_id=857ef5e1c285487ea0581440e158cfe8, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:27.246687 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038034-855b-411e-964c-889142478bac admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:27.260925 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1368/2774] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:46:27 2022] PUT /identity/v3/projects/d0caff361d864a2c8f8e65cb2efae05a/users/857ef5e1c285487ea0581440e158cfe8/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:27.273063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851850-51fa-43e7-b0f4-6270379c474a None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:27.273520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851850-51fa-43e7-b0f4-6270379c474a None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:27.273893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851850-51fa-43e7-b0f4-6270379c474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:27.305938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-96851850-51fa-43e7-b0f4-6270379c474a None None] MFA Rules not processed for user `857ef5e1c285487ea0581440e158cfe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:27.307224 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-96851850-51fa-43e7-b0f4-6270379c474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:27.354305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:27.375614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1407/2775] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:27.386527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038034-855b-411e-964c-889142478bac admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:27.388425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f9038034-855b-411e-964c-889142478bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:27.402922 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:27.452117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038034-855b-411e-964c-889142478bac admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:27.456014 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aee9b-1414-46b7-b9e5-ea1e2865d53f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:27.456617 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aee9b-1414-46b7-b9e5-ea1e2865d53f service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:27.456870 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aee9b-1414-46b7-b9e5-ea1e2865d53f service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:27.457157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aee9b-1414-46b7-b9e5-ea1e2865d53f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:27.467016 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aee9b-1414-46b7-b9e5-ea1e2865d53f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:27.468481 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aee9b-1414-46b7-b9e5-ea1e2865d53f service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:27.478486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1369/2776] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:46:37.372460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=6 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:37.473786 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=21 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:57.765885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851850-51fa-43e7-b0f4-6270379c474a None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:57.836243 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851850-51fa-43e7-b0f4-6270379c474a None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:57.842195 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:57.842833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:57.843112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:57.843383 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] PATH_INFO: `/v3/users/857ef5e1c285487ea0581440e158cfe8` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:57.844552 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857ef5e1c285487ea0581440e158cfe8)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:57.846515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:57.897447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857ef5e1c285487ea0581440e158cfe8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:57.898165 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857ef5e1c285487ea0581440e158cfe8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:57.906110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857ef5e1c285487ea0581440e158cfe8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:57.906789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857ef5e1c285487ea0581440e158cfe8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:57.918667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857ef5e1c285487ea0581440e158cfe8'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:57.936923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1408/2777] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:46:57 2022] DELETE /identity/v3/users/857ef5e1c285487ea0581440e158cfe8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:57.941455 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:57.941963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:57.942150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:57.961997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:57.963310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:58.032748 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1370/2778] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:58.045150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:58.047468 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:58.111624 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b980f05-1a6b-4454-b360-cfa87acb5ab1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:58.115626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969432-67e7-45c6-a39d-08ce056385c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:58.116259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969432-67e7-45c6-a39d-08ce056385c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.116529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969432-67e7-45c6-a39d-08ce056385c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.116797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969432-67e7-45c6-a39d-08ce056385c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.126722 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969432-67e7-45c6-a39d-08ce056385c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:58.128178 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969432-67e7-45c6-a39d-08ce056385c7 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:58.137934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1409/2779] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:46:58.452417 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:58.453953 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:58.466220 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231926-d3a5-478b-bb39-33cc3b8a5caa None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:58.471433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:58.472104 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.472384 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.472658 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] PATH_INFO: `/v3/projects/d0caff361d864a2c8f8e65cb2efae05a` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.473857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0caff361d864a2c8f8e65cb2efae05a)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:58.475892 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:58.524993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0caff361d864a2c8f8e65cb2efae05a', 'request_id': 'req-9f2014ec-ca56-4619-a245-254ebc9985f5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:58.533157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0caff361d864a2c8f8e65cb2efae05a', 'request_id': 'req-9f2014ec-ca56-4619-a245-254ebc9985f5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:58.539450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0caff361d864a2c8f8e65cb2efae05a', 'request_id': 'req-9f2014ec-ca56-4619-a245-254ebc9985f5'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:58.554039 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] The token cache is being invalidate because project d0caff361d864a2c8f8e65cb2efae05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:46:58.554328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:58.554978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-9f2014ec-ca56-4619-a245-254ebc9985f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:58.556552 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1371/2780] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:46:58 2022] DELETE /identity/v3/projects/d0caff361d864a2c8f8e65cb2efae05a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:58.562057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbbb4f-7b19-491e-a49c-0806f24f1745 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.562322 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbbb4f-7b19-491e-a49c-0806f24f1745 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.562685 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbbb4f-7b19-491e-a49c-0806f24f1745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.586210 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-c4dbbb4f-7b19-491e-a49c-0806f24f1745 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:58.588274 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-c4dbbb4f-7b19-491e-a49c-0806f24f1745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:58.607335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:58.651953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1410/2781] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:58.662856 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be64b-134c-4243-98f3-1bf7a36fdb15 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.663143 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be64b-134c-4243-98f3-1bf7a36fdb15 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.663410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006be64b-134c-4243-98f3-1bf7a36fdb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.684437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-006be64b-134c-4243-98f3-1bf7a36fdb15 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:58.685650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-006be64b-134c-4243-98f3-1bf7a36fdb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:58.694708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1372/2782] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:58.699235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbbb4f-7b19-491e-a49c-0806f24f1745 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:58.709270 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbbb4f-7b19-491e-a49c-0806f24f1745 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:58.720324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:58.720935 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.721202 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.721498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.722144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:46:58.722440 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:58.724099 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:58.736971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1411/2783] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:46:58.741828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006be64b-134c-4243-98f3-1bf7a36fdb15 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:58.752371 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006be64b-134c-4243-98f3-1bf7a36fdb15 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:58.757938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:58.758559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.758842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.759119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.759796 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:58.762319 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:58.792421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1373/2784] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:46:58 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:46:58.796937 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:58.807273 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4bbd8-6791-467a-85b5-b614585236da admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:58.881525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:58.882863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.883239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.883587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.884469 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:58.886828 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:58.911632 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1412/2785] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:46:58 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:46:58.917115 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:58.928742 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d178a5-fc44-4fc8-8f8b-9ac4c87cc2d6 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:58.935523 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:58.940035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.940035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.940035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.940035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:58.941004 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:58.957387 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1374/2786] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:46:58.962137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:58.977645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a2373-d5cd-4f23-91a6-a0a4ad0b9554 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:58.984326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c4ca3-83e4-4a58-b6b1-c678d2bd5516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:58.985214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c4ca3-83e4-4a58-b6b1-c678d2bd5516 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:58.985573 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c4ca3-83e4-4a58-b6b1-c678d2bd5516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:58.985837 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c4ca3-83e4-4a58-b6b1-c678d2bd5516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:58.986732 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c4ca3-83e4-4a58-b6b1-c678d2bd5516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:58.989309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c4ca3-83e4-4a58-b6b1-c678d2bd5516 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:59.006544 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1413/2787] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:46:59.012398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:59.023185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c2c17-8f3e-4369-af2b-e7d1bcb4ff32 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:59.028529 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:59.029186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:59.029438 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:59.029713 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] PATH_INFO: `/v3/projects/5a1c1a259990482791628c03fb93b10c/users/6308d3b40ee14822920c63551e4a86d2/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:59.045547 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1c1a259990482791628c03fb93b10c, user_id=6308d3b40ee14822920c63551e4a86d2, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:59.048250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:59.064097 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1375/2788] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:46:59 2022] PUT /identity/v3/projects/5a1c1a259990482791628c03fb93b10c/users/6308d3b40ee14822920c63551e4a86d2/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:59.076280 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536f93-16fc-41b4-a264-80be7eb04417 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:59.076569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536f93-16fc-41b4-a264-80be7eb04417 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:59.076833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536f93-16fc-41b4-a264-80be7eb04417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:59.105986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-4e536f93-16fc-41b4-a264-80be7eb04417 None None] MFA Rules not processed for user `6308d3b40ee14822920c63551e4a86d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:59.107219 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-4e536f93-16fc-41b4-a264-80be7eb04417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:59.190485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1414/2789] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:46:59.202117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:59.204150 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:59.226910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:59.265289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffecf6-d7d1-4c6a-9fa3-839e04f0196b admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:59.269262 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fce2b-03e3-43a3-9ff7-60b55a6e032e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:59.270188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fce2b-03e3-43a3-9ff7-60b55a6e032e service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:59.270465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fce2b-03e3-43a3-9ff7-60b55a6e032e service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:59.270736 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fce2b-03e3-43a3-9ff7-60b55a6e032e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:59.279768 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fce2b-03e3-43a3-9ff7-60b55a6e032e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:59.281199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fce2b-03e3-43a3-9ff7-60b55a6e032e service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:59.289904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1376/2790] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:46:59.315757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536f93-16fc-41b4-a264-80be7eb04417 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:59.335922 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:46:59.383736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536f93-16fc-41b4-a264-80be7eb04417 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:59.388958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:59.389586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:59.389858 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:59.390121 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] PATH_INFO: `/v3/users/6308d3b40ee14822920c63551e4a86d2` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:59.391298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6308d3b40ee14822920c63551e4a86d2)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:59.393246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:59.454214 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6308d3b40ee14822920c63551e4a86d2'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:59.454798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6308d3b40ee14822920c63551e4a86d2'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:59.461930 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6308d3b40ee14822920c63551e4a86d2'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:59.462560 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6308d3b40ee14822920c63551e4a86d2'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:59.478422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6308d3b40ee14822920c63551e4a86d2'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:46:59.506261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1415/2791] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:46:59 2022] DELETE /identity/v3/users/6308d3b40ee14822920c63551e4a86d2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:46:59.512013 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:59.512299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:59.512591 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:59.532966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:46:59.534195 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:59.596320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1377/2792] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:46:59.606313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:59.607865 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:59.667492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0983c-89ba-4c50-85f9-95ac26c4f9d0 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:46:59.671743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:46:59.672356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:46:59.672643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:46:59.672915 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:46:59.683260 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:46:59.684741 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:46:59.694921 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1416/2793] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:46:59.984688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:46:59.986396 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:46:59.999986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feb8b3-b991-4cd6-8d5d-70160dfa0892 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:47:00.005299 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:47:00.005964 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:00.006243 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:00.006506 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] PATH_INFO: `/v3/projects/5a1c1a259990482791628c03fb93b10c` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:00.007690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1c1a259990482791628c03fb93b10c)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:47:00.009616 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:47:00.062411 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1c1a259990482791628c03fb93b10c', 'request_id': 'req-a1572206-a8af-489c-a815-16d7666240c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:00.072410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1c1a259990482791628c03fb93b10c', 'request_id': 'req-a1572206-a8af-489c-a815-16d7666240c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:00.079711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1c1a259990482791628c03fb93b10c', 'request_id': 'req-a1572206-a8af-489c-a815-16d7666240c2'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:00.090604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] The token cache is being invalidate because project 5a1c1a259990482791628c03fb93b10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:47:00.090887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:00.091556 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-a1572206-a8af-489c-a815-16d7666240c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:00.093077 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1378/2794] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:46:59 2022] DELETE /identity/v3/projects/5a1c1a259990482791628c03fb93b10c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:47:09.690431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:10.087714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:30.941525 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:47:30.943157 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:47:31.117387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c540-636c-442a-8bb4-b41779355db9 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:47:31.183613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:47:31.184235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:31.184517 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:31.184986 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:31.186971 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:47:31.199084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:47:31.201443 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:47:31.212160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1417/2795] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:47:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:47:40.426071 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:40.426600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:40.426600 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:40.459006 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] MFA Rules not processed for user `809566003ec643fe82727431941fe3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:47:40.460280 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:47:40.534819 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1379/2796] 10.222.0.88 () {58 vars in 967 bytes} [Wed Aug 24 16:47:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:47:40.582717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:47:40.584259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:47:40.612124 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=100 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:40.662743 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83519aca-933f-4da4-a1f6-793f0ec3e73c service placement] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:47:40.668535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed343e58e9d494aa4b303e5bf95b54e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:47:40.669145 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:40.669422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:40.669695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:40.678555 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:47:40.680196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:47:40.688842 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1418/2797] 10.222.0.88 () {60 vars in 1384 bytes} [Wed Aug 24 16:47:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:47:47.617589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:47:47.619124 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:47:47.720518 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620675b5-272b-44b9-8d72-9da4df92226e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:47:47.725537 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:47:47.726169 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:47.726445 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:47.726716 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] PATH_INFO: `/v3/users/ba5fbe65692d4ae2a102e660d6fc32b1` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:47.727918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5fbe65692d4ae2a102e660d6fc32b1)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:47:47.729835 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:47:47.778789 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5fbe65692d4ae2a102e660d6fc32b1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:47.785686 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5fbe65692d4ae2a102e660d6fc32b1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:47.790997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:47.799118 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5fbe65692d4ae2a102e660d6fc32b1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:47.808816 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5fbe65692d4ae2a102e660d6fc32b1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:47.809515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5fbe65692d4ae2a102e660d6fc32b1'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:47.816351 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1380/2798] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:47:47 2022] DELETE /identity/v3/users/ba5fbe65692d4ae2a102e660d6fc32b1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:47:48.005521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:47:48.024167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27709354-502e-4d06-a433-c42aee1e7ff0 service swift] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:47:48.084258 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:47:48.084959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:48.085256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:48.085543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] PATH_INFO: `/v3/projects/f62a8f29b4fe49f88d816788507cf0eb` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:48.086745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62a8f29b4fe49f88d816788507cf0eb)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:47:48.088745 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:47:48.138708 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62a8f29b4fe49f88d816788507cf0eb', 'request_id': 'req-e4c67700-477a-40e6-be34-60e960b468cd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.145529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62a8f29b4fe49f88d816788507cf0eb', 'request_id': 'req-e4c67700-477a-40e6-be34-60e960b468cd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.151894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62a8f29b4fe49f88d816788507cf0eb', 'request_id': 'req-e4c67700-477a-40e6-be34-60e960b468cd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.171237 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] The token cache is being invalidate because project f62a8f29b4fe49f88d816788507cf0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:47:48.171521 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.172247 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.173783 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1419/2799] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:47:48 2022] DELETE /identity/v3/projects/f62a8f29b4fe49f88d816788507cf0eb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:47:48.178028 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:47:48.179690 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:47:48.194123 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5aaaa-444e-4ffa-993d-bd6982997022 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:47:48.253140 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:47:48.253779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:48.254060 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:48.254334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] PATH_INFO: `/v3/users/abe6f7132870448b897b20c28c7a1ad8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:48.255489 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe6f7132870448b897b20c28c7a1ad8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:47:48.257466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:47:48.312471 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe6f7132870448b897b20c28c7a1ad8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.320646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe6f7132870448b897b20c28c7a1ad8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.332733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe6f7132870448b897b20c28c7a1ad8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.345064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe6f7132870448b897b20c28c7a1ad8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.345758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-c01aff1a-0f94-40db-9a9d-3b43295e05cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe6f7132870448b897b20c28c7a1ad8'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.352512 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1381/2800] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:47:48 2022] DELETE /identity/v3/users/abe6f7132870448b897b20c28c7a1ad8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:47:48.536162 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:47:48.537809 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:47:48.551551 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c67700-477a-40e6-be34-60e960b468cd admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:47:48.595244 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:48.615882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:47:48.616683 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:47:48.616943 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:47:48.617220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] PATH_INFO: `/v3/projects/9e234d8c5d2b41fdb36a7d83c7bfb0b1` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:47:48.618996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e234d8c5d2b41fdb36a7d83c7bfb0b1)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:47:48.621644 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:47:48.669483 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e234d8c5d2b41fdb36a7d83c7bfb0b1', 'request_id': 'req-8602724a-03f3-40eb-b2e9-83c4a064bc5f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.675395 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e234d8c5d2b41fdb36a7d83c7bfb0b1', 'request_id': 'req-8602724a-03f3-40eb-b2e9-83c4a064bc5f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.681498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e234d8c5d2b41fdb36a7d83c7bfb0b1', 'request_id': 'req-8602724a-03f3-40eb-b2e9-83c4a064bc5f'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.695492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] The token cache is being invalidate because project 9e234d8c5d2b41fdb36a7d83c7bfb0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81535) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:47:48.695847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.696519 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:47:48.698004 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1420/2801] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:47:48 2022] DELETE /identity/v3/projects/9e234d8c5d2b41fdb36a7d83c7bfb0b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:47:58.348644 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=59,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:47:58.692760 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:48:12.102693 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af95f-4837-4feb-b1ee-ba70ee40658e None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:48:12.103337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af95f-4837-4feb-b1ee-ba70ee40658e None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:48:12.103337 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606af95f-4837-4feb-b1ee-ba70ee40658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:48:12.126383 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-606af95f-4837-4feb-b1ee-ba70ee40658e None None] MFA Rules not processed for user `109614e279ad4057a5908636e6c21a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:48:12.127997 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-606af95f-4837-4feb-b1ee-ba70ee40658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:48:12.202444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1382/2802] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:48:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:48:22.189460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=25 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:22.529704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:22.531228 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:22.599212 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602724a-03f3-40eb-b2e9-83c4a064bc5f admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:22.604196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:22.604914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:22.605190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:22.605458 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] PATH_INFO: `/v3/users/109614e279ad4057a5908636e6c21a3e` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:22.606738 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=109614e279ad4057a5908636e6c21a3e)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:22.608717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:22.659393 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109614e279ad4057a5908636e6c21a3e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:22.660082 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109614e279ad4057a5908636e6c21a3e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:22.666807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109614e279ad4057a5908636e6c21a3e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:22.667417 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109614e279ad4057a5908636e6c21a3e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:22.675730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-1ec7887e-ab50-49e0-94aa-770f58211ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109614e279ad4057a5908636e6c21a3e'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:22.698101 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1421/2803] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:49:22 2022] DELETE /identity/v3/users/109614e279ad4057a5908636e6c21a3e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:22.883413 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606af95f-4837-4feb-b1ee-ba70ee40658e None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:22.895281 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606af95f-4837-4feb-b1ee-ba70ee40658e None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:22.957160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:22.957742 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:22.958020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:22.958289 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] PATH_INFO: `/v3/projects/e6a679b7c521489684c602823030ff4b` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:22.959597 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a679b7c521489684c602823030ff4b)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:22.961567 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.011057 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a679b7c521489684c602823030ff4b', 'request_id': 'req-ccdcc74d-e028-40a2-b638-2e9300ccbc41'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:23.020332 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a679b7c521489684c602823030ff4b', 'request_id': 'req-ccdcc74d-e028-40a2-b638-2e9300ccbc41'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:23.026938 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a679b7c521489684c602823030ff4b', 'request_id': 'req-ccdcc74d-e028-40a2-b638-2e9300ccbc41'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:23.037458 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] The token cache is being invalidate because project e6a679b7c521489684c602823030ff4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:49:23.037742 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:23.038394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-ccdcc74d-e028-40a2-b638-2e9300ccbc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:23.039939 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1383/2804] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:49:22 2022] DELETE /identity/v3/projects/e6a679b7c521489684c602823030ff4b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:23.044970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfa0e7-4d9f-41b1-9fc6-c7e43fac0b75 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.045253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfa0e7-4d9f-41b1-9fc6-c7e43fac0b75 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.045543 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfa0e7-4d9f-41b1-9fc6-c7e43fac0b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.105208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-49cfa0e7-4d9f-41b1-9fc6-c7e43fac0b75 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:23.106421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-49cfa0e7-4d9f-41b1-9fc6-c7e43fac0b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:23.153562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:23.170211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1422/2805] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:23.178334 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a1d85-04eb-4d40-99b2-7c6343907fc5 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.178621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a1d85-04eb-4d40-99b2-7c6343907fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.178891 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a1d85-04eb-4d40-99b2-7c6343907fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.199923 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-232a1d85-04eb-4d40-99b2-7c6343907fc5 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:23.201159 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-232a1d85-04eb-4d40-99b2-7c6343907fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:23.210165 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1384/2806] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:23.214548 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfa0e7-4d9f-41b1-9fc6-c7e43fac0b75 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.224972 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfa0e7-4d9f-41b1-9fc6-c7e43fac0b75 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:23.230651 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:23.231242 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.231520 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.231831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.232482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:23.232790 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:23.234446 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.247222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1423/2807] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:23.252899 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a1d85-04eb-4d40-99b2-7c6343907fc5 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.262480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a1d85-04eb-4d40-99b2-7c6343907fc5 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:23.269784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:23.270633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.270998 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.271626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.272571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:23.275494 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.316418 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1385/2808] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:49:23 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:23.321166 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.332132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05067c0-5aa5-45c5-a6b0-fdcdc7653721 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:23.397898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:23.398523 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.398797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.399061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.399727 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:23.401650 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.426175 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1424/2809] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:49:23 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:23.430355 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.440738 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e030c4-43be-4131-bdbd-cb6528906257 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:23.445770 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:23.446395 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.446671 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.446940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.447571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:23.449196 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.459349 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1386/2810] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:23.463424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.475882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954027d-1103-4231-ac5f-d1f5abdd0fbe admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:23.483999 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460feb1f-00fe-47dc-9f22-34e4225692a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:23.485305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460feb1f-00fe-47dc-9f22-34e4225692a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.485589 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460feb1f-00fe-47dc-9f22-34e4225692a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.485863 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460feb1f-00fe-47dc-9f22-34e4225692a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.486515 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460feb1f-00fe-47dc-9f22-34e4225692a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:23.488184 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460feb1f-00fe-47dc-9f22-34e4225692a4 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.499321 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1425/2811] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:23.503797 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.514323 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d956cde-13bf-4784-85f2-f28248a4cbcd admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:23.520708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:23.521728 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.521994 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.522269 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] PATH_INFO: `/v3/projects/991552fa95b54598a31f8871add16ed7/users/33d69b0c2a234b139cd754b461e95e10/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.538221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=991552fa95b54598a31f8871add16ed7, user_id=33d69b0c2a234b139cd754b461e95e10, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:23.540986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.557225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1387/2812] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:23 2022] PUT /identity/v3/projects/991552fa95b54598a31f8871add16ed7/users/33d69b0c2a234b139cd754b461e95e10/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:23.571936 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.572431 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.572567 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.602718 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] MFA Rules not processed for user `33d69b0c2a234b139cd754b461e95e10`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:23.603946 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:23.673276 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1426/2813] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:23.685138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.687208 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:23.712436 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:23.799414 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007550ee-4465-4fe1-8265-74c3a173ef1a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:23.805673 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:23.806273 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:23.806572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:23.806841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:23.815410 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:23.817020 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:23.825776 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1388/2814] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:23.912216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:23.913896 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:23.965719 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:24.005912 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71daa66-58c1-4a4b-8a62-54c052ff9c16 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:24.010553 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:24.011174 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.011447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.011757 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.013871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:24.029583 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:24.031077 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:24.042717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1427/2815] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:24.113392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:24.115231 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:24.128534 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b75882-78d1-4077-9c44-623219cb275a service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:24.133298 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13e4cb-347e-4d2f-8be3-bfca4dc9c3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:24.133926 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13e4cb-347e-4d2f-8be3-bfca4dc9c3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.134204 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13e4cb-347e-4d2f-8be3-bfca4dc9c3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.134475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13e4cb-347e-4d2f-8be3-bfca4dc9c3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.136476 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aa13e4cb-347e-4d2f-8be3-bfca4dc9c3f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:24.150969 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13e4cb-347e-4d2f-8be3-bfca4dc9c3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:24.152427 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13e4cb-347e-4d2f-8be3-bfca4dc9c3f0 service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:24.163729 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1389/2816] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:24.242582 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:24.305086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a4a00-e452-4102-a562-e47c0ac33fbb service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:24.309815 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:24.310453 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.310730 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.311005 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] PATH_INFO: `/v3/users/33d69b0c2a234b139cd754b461e95e10` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.312168 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d69b0c2a234b139cd754b461e95e10)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:24.314314 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:24.370665 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d69b0c2a234b139cd754b461e95e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:24.371394 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d69b0c2a234b139cd754b461e95e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:24.378631 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d69b0c2a234b139cd754b461e95e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:24.379309 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d69b0c2a234b139cd754b461e95e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:24.388107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d69b0c2a234b139cd754b461e95e10'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:24.406349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1428/2817] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:49:24 2022] DELETE /identity/v3/users/33d69b0c2a234b139cd754b461e95e10 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:24.410854 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.411146 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.411427 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.434199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:24.435452 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:24.498800 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1390/2818] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:24.509404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:24.511885 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:24.567870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:24.596313 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09897e-170d-4039-a98f-b32fa7d69acb admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:24.600956 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca166abb-3a81-421b-8872-2385918182bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:24.601566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166abb-3a81-421b-8872-2385918182bd service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.601843 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166abb-3a81-421b-8872-2385918182bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.602107 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca166abb-3a81-421b-8872-2385918182bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.611919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca166abb-3a81-421b-8872-2385918182bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:24.613380 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca166abb-3a81-421b-8872-2385918182bd service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:24.623000 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1429/2819] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:24.914106 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:24.915561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:24.928901 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f38b96-b2ff-4d56-ac90-b3d59dccd2f4 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:24.939055 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:24.939877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.940058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.940320 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] PATH_INFO: `/v3/projects/991552fa95b54598a31f8871add16ed7` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.941659 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991552fa95b54598a31f8871add16ed7)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:24.943572 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:24.994188 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991552fa95b54598a31f8871add16ed7', 'request_id': 'req-35861b73-7663-427d-aa4d-98920d888df3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:25.004883 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991552fa95b54598a31f8871add16ed7', 'request_id': 'req-35861b73-7663-427d-aa4d-98920d888df3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:25.014952 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991552fa95b54598a31f8871add16ed7', 'request_id': 'req-35861b73-7663-427d-aa4d-98920d888df3'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:25.019815 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:25.028538 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] The token cache is being invalidate because project 991552fa95b54598a31f8871add16ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:49:25.028841 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:25.029571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-35861b73-7663-427d-aa4d-98920d888df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:25.032375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1391/2820] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:49:24 2022] DELETE /identity/v3/projects/991552fa95b54598a31f8871add16ed7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:25.039012 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb865ccd-4558-46e6-9293-132e6ed6f47d None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.039312 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb865ccd-4558-46e6-9293-132e6ed6f47d None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.039620 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb865ccd-4558-46e6-9293-132e6ed6f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.061356 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-cb865ccd-4558-46e6-9293-132e6ed6f47d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:25.062657 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-cb865ccd-4558-46e6-9293-132e6ed6f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:25.130611 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1430/2821] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:25.141221 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432e3ff-d149-4c98-89c9-da5e58fdfb5c None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.141766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432e3ff-d149-4c98-89c9-da5e58fdfb5c None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.141766 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432e3ff-d149-4c98-89c9-da5e58fdfb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.166260 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2432e3ff-d149-4c98-89c9-da5e58fdfb5c None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:25.168381 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2432e3ff-d149-4c98-89c9-da5e58fdfb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:25.179721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1392/2822] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:25.184503 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb865ccd-4558-46e6-9293-132e6ed6f47d None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.196976 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb865ccd-4558-46e6-9293-132e6ed6f47d None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.203006 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.204290 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.204575 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.204851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.205511 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:25.205814 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.207438 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.220599 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1431/2823] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:25.225198 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432e3ff-d149-4c98-89c9-da5e58fdfb5c None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.235422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432e3ff-d149-4c98-89c9-da5e58fdfb5c None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.241726 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.242322 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.242599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.242866 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.243480 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.245435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.281641 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1393/2824] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:49:25 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:25.286225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.296960 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556f070-22d5-4de9-8afe-635362033b6a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.358010 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.358617 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.358893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.359163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.359871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.361771 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.391253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1432/2825] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:49:25 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:25.396026 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.407741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d0124-ab0e-468b-9ae4-f1f983b9dbc0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.413082 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.413674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.413951 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.414219 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.414861 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.416492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.426808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1394/2826] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:25.431023 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.441798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4cb7-f03c-42f3-bbff-04d8907959c6 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.446898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f806f9e-5e49-4bd6-b54d-15968dfab87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.447492 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806f9e-5e49-4bd6-b54d-15968dfab87d admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.447798 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806f9e-5e49-4bd6-b54d-15968dfab87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.448066 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806f9e-5e49-4bd6-b54d-15968dfab87d admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.448701 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f806f9e-5e49-4bd6-b54d-15968dfab87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.450415 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f806f9e-5e49-4bd6-b54d-15968dfab87d admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.462324 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1433/2827] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:49:25.466704 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.477093 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532f28-226c-41b2-bee0-0e97bbbe7e98 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.481995 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.482642 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.482910 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.483177 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] PATH_INFO: `/v3/projects/352e69882fe340678f62514769d6a7c8/users/d5d280ab28f04247be9107e9f9839a15/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.498226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352e69882fe340678f62514769d6a7c8, user_id=d5d280ab28f04247be9107e9f9839a15, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.501063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.516058 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1395/2828] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:25 2022] PUT /identity/v3/projects/352e69882fe340678f62514769d6a7c8/users/d5d280ab28f04247be9107e9f9839a15/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:49:25.527160 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbca0b-b5a3-4e07-94c6-986370cbc45b None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.527514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbca0b-b5a3-4e07-94c6-986370cbc45b None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.527810 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbca0b-b5a3-4e07-94c6-986370cbc45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.556002 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-e3bbca0b-b5a3-4e07-94c6-986370cbc45b None None] MFA Rules not processed for user `d5d280ab28f04247be9107e9f9839a15`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:25.557206 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-e3bbca0b-b5a3-4e07-94c6-986370cbc45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:25.583705 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:25.627634 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1434/2829] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:25.634945 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.719044 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c64d5-b33c-4fab-be51-73c008ec2645 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.724287 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.725023 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.725305 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.725590 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.726222 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.728199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.759155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1396/2830] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:49:25 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:25.763720 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbca0b-b5a3-4e07-94c6-986370cbc45b None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.775940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbca0b-b5a3-4e07-94c6-986370cbc45b None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.841335 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.841953 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.842239 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.842502 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.843132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.845310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.868144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1435/2831] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:49:25 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:25.872238 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.883109 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6298080-95de-451c-b251-89c106ebfee0 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.887896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.888501 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.888779 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.889049 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.889702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.891402 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.902573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1397/2832] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:25.906883 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.917360 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d90d-3016-49c8-b242-868574d048d3 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:25.923190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:25.923869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:25.924150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:25.924418 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] PATH_INFO: `/v3/projects/b90f409420c14418ae7eff5b66433887/users/84d4770f43d2466eadeb47ef99400fe7/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:25.940306 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90f409420c14418ae7eff5b66433887, user_id=84d4770f43d2466eadeb47ef99400fe7, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:25.942962 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:25.959283 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1436/2833] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:25 2022] PUT /identity/v3/projects/b90f409420c14418ae7eff5b66433887/users/84d4770f43d2466eadeb47ef99400fe7/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:25.963397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:25.974680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c20d9-7120-4003-8769-ac88a8998be3 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:26.033253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc9185-6905-41b2-bc26-c168d14edac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:26.033876 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9185-6905-41b2-bc26-c168d14edac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:26.034155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9185-6905-41b2-bc26-c168d14edac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:26.034431 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc9185-6905-41b2-bc26-c168d14edac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:26.035061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc9185-6905-41b2-bc26-c168d14edac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:26.036714 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc9185-6905-41b2-bc26-c168d14edac5 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:26.041940 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:26.047158 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1398/2834] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:26.051533 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:26.061954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d9ef5-1926-4127-a74a-d9fddba83adc admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:26.066800 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:26.067450 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:26.067770 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:26.068045 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] PATH_INFO: `/v3/projects/b90f409420c14418ae7eff5b66433887/users/84d4770f43d2466eadeb47ef99400fe7/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:26.069970 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90f409420c14418ae7eff5b66433887, user_id=84d4770f43d2466eadeb47ef99400fe7, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:26.072686 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:26.083534 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1437/2835] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:26 2022] PUT /identity/v3/projects/b90f409420c14418ae7eff5b66433887/users/84d4770f43d2466eadeb47ef99400fe7/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:26.094695 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1ace-dad9-449a-bc24-e8e9739a5411 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:26.094990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1ace-dad9-449a-bc24-e8e9739a5411 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:26.095313 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1ace-dad9-449a-bc24-e8e9739a5411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:26.124944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-6e7c1ace-dad9-449a-bc24-e8e9739a5411 None None] MFA Rules not processed for user `84d4770f43d2466eadeb47ef99400fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:26.126812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6e7c1ace-dad9-449a-bc24-e8e9739a5411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:26.205433 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1399/2836] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:26.217196 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:26.220135 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:26.292264 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a339f3-ebea-4c64-a128-b920a80af1a1 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:26.296451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:26.297115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:26.297401 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:26.297670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:26.308498 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:26.309954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:26.320296 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1438/2837] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:26.427063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1ace-dad9-449a-bc24-e8e9739a5411 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:26.437457 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1ace-dad9-449a-bc24-e8e9739a5411 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:26.441459 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81059e7-2041-445f-b7a1-34d1043d4f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:26.442064 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81059e7-2041-445f-b7a1-34d1043d4f8a service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:26.442342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81059e7-2041-445f-b7a1-34d1043d4f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:26.442615 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81059e7-2041-445f-b7a1-34d1043d4f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:26.508497 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81059e7-2041-445f-b7a1-34d1043d4f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:26.509868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81059e7-2041-445f-b7a1-34d1043d4f8a service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:26.519473 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1400/2838] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:29.183035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:29.207731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:29.250604 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54eadd-f587-4031-a53a-595116bde158 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:29.256621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:29.257253 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:29.257526 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:29.257802 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] PATH_INFO: `/v3/users/d5d280ab28f04247be9107e9f9839a15` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:29.259038 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d280ab28f04247be9107e9f9839a15)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:29.261007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:29.321906 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d280ab28f04247be9107e9f9839a15'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.322698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d280ab28f04247be9107e9f9839a15'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.330655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d280ab28f04247be9107e9f9839a15'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.331529 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d280ab28f04247be9107e9f9839a15'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.341067 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d280ab28f04247be9107e9f9839a15'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.362221 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1439/2839] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:49:29 2022] DELETE /identity/v3/users/d5d280ab28f04247be9107e9f9839a15 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:29.367110 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:29.367633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:29.367752 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:29.388056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:29.389270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:29.466378 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1401/2840] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:29.478903 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:29.480414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:29.538910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72973-0827-4b2d-9732-31f91ca3332a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:29.542939 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:29.543545 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:29.543850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:29.544118 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:29.555081 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:29.556582 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:29.567070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1440/2841] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:29.855884 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:29.857342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:29.870230 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5f385-bd78-4bc9-8aff-0ecc93db5138 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:29.876117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:29.877460 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:29.877772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:29.878061 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] PATH_INFO: `/v3/projects/352e69882fe340678f62514769d6a7c8` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:29.879449 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352e69882fe340678f62514769d6a7c8)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:29.881758 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:29.906558 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=100 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:29.935166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352e69882fe340678f62514769d6a7c8', 'request_id': 'req-3535c399-f99c-4aaa-8fbd-de8286be1118'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.944592 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352e69882fe340678f62514769d6a7c8', 'request_id': 'req-3535c399-f99c-4aaa-8fbd-de8286be1118'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.951025 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352e69882fe340678f62514769d6a7c8', 'request_id': 'req-3535c399-f99c-4aaa-8fbd-de8286be1118'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.965565 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] The token cache is being invalidate because project 352e69882fe340678f62514769d6a7c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:49:29.965857 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.966486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:29.968119 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1402/2842] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:49:29 2022] DELETE /identity/v3/projects/352e69882fe340678f62514769d6a7c8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:29.973084 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:29.985225 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89067b4-703c-4dfb-9532-6035417841de service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:30.037030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:30.056698 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:30.057329 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.057621 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.057884 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] PATH_INFO: `/v3/users/84d4770f43d2466eadeb47ef99400fe7` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.058997 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d4770f43d2466eadeb47ef99400fe7)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:30.061051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:30.112736 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d4770f43d2466eadeb47ef99400fe7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.113373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d4770f43d2466eadeb47ef99400fe7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.120220 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d4770f43d2466eadeb47ef99400fe7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.120898 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d4770f43d2466eadeb47ef99400fe7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.130297 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-6e1b3b27-a9f4-48eb-abc9-dfd754063600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d4770f43d2466eadeb47ef99400fe7'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.148957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1441/2843] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:49:29 2022] DELETE /identity/v3/users/84d4770f43d2466eadeb47ef99400fe7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:30.428832 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:30.430314 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:30.443341 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535c399-f99c-4aaa-8fbd-de8286be1118 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:30.504066 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:30.504670 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.504954 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.505258 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] PATH_INFO: `/v3/projects/b90f409420c14418ae7eff5b66433887` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.506505 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90f409420c14418ae7eff5b66433887)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:30.508571 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:30.557393 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90f409420c14418ae7eff5b66433887', 'request_id': 'req-e6e35515-da67-4dfe-8a80-c6925c07bc4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.567242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90f409420c14418ae7eff5b66433887', 'request_id': 'req-e6e35515-da67-4dfe-8a80-c6925c07bc4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.573765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90f409420c14418ae7eff5b66433887', 'request_id': 'req-e6e35515-da67-4dfe-8a80-c6925c07bc4c'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.584869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] The token cache is being invalidate because project b90f409420c14418ae7eff5b66433887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:49:30.585126 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.585772 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-e6e35515-da67-4dfe-8a80-c6925c07bc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:30.587282 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1403/2844] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:49:30 2022] DELETE /identity/v3/projects/b90f409420c14418ae7eff5b66433887 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:30.592310 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b44e-c3f3-4d16-bb2f-3a63147f3854 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.592774 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b44e-c3f3-4d16-bb2f-3a63147f3854 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.592958 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b44e-c3f3-4d16-bb2f-3a63147f3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.615731 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b600b44e-c3f3-4d16-bb2f-3a63147f3854 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:30.616949 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b600b44e-c3f3-4d16-bb2f-3a63147f3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:30.682288 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1442/2845] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:30.691879 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21169ad-15cd-457e-a598-ab1e466c4a85 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.692161 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21169ad-15cd-457e-a598-ab1e466c4a85 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.692435 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21169ad-15cd-457e-a598-ab1e466c4a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.713679 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-f21169ad-15cd-457e-a598-ab1e466c4a85 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:30.714944 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f21169ad-15cd-457e-a598-ab1e466c4a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:30.724817 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1404/2846] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:30.729330 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b44e-c3f3-4d16-bb2f-3a63147f3854 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:30.739696 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b44e-c3f3-4d16-bb2f-3a63147f3854 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:30.745115 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:30.745717 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.745991 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.746259 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.747111 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:30.747411 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:30.749298 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:30.761780 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1443/2847] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:30.766167 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21169ad-15cd-457e-a598-ab1e466c4a85 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:30.776631 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21169ad-15cd-457e-a598-ab1e466c4a85 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:30.781814 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:30.782406 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.782678 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.782948 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.783561 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:30.785709 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:30.817955 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1405/2848] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:30.822150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:30.832546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ff7d3-b5d3-43dd-8fba-6d91e80e5849 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:30.885668 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:30.901279 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:30.902068 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.902432 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.902961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.903614 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:30.905663 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:30.929147 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1444/2849] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:30.933475 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:30.944437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c7925-7270-404c-b889-11d326eaca3f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:30.949868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:30.950468 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.950745 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.951012 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.951778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:30.953530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:30.955775 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:30.965465 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1406/2850] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:30.969728 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:30.980796 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecd450-2362-4795-9394-95db17b5f087 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:30.987098 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e80520-d277-4b94-bcb7-3fe8332afcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:30.987733 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80520-d277-4b94-bcb7-3fe8332afcff admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.988011 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80520-d277-4b94-bcb7-3fe8332afcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.988265 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e80520-d277-4b94-bcb7-3fe8332afcff admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.988940 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e80520-d277-4b94-bcb7-3fe8332afcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:30.990536 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e80520-d277-4b94-bcb7-3fe8332afcff admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.002850 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1445/2851] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:49:31.007155 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.017682 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86175f4f-dfed-4b38-8af7-6c4e3a2e2596 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.023128 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.023836 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.024151 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.024420 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] PATH_INFO: `/v3/projects/159f200ff49f49fe9acae28ed2d8256f/users/a503979c828f4add9052cc8f42ed37bd/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.040069 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=159f200ff49f49fe9acae28ed2d8256f, user_id=a503979c828f4add9052cc8f42ed37bd, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.042776 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.061166 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1407/2852] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:31 2022] PUT /identity/v3/projects/159f200ff49f49fe9acae28ed2d8256f/users/a503979c828f4add9052cc8f42ed37bd/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:31.072097 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816280c-9467-4d92-8919-a5398090d9bd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.072388 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816280c-9467-4d92-8919-a5398090d9bd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.072655 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816280c-9467-4d92-8919-a5398090d9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.103110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-0816280c-9467-4d92-8919-a5398090d9bd None None] MFA Rules not processed for user `a503979c828f4add9052cc8f42ed37bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:31.104361 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-0816280c-9467-4d92-8919-a5398090d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:31.170596 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1446/2853] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:31.177540 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.250906 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dee543-07df-4819-9e62-3abf94469e6f admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.256798 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.257407 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.257694 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.257971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.258599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.260559 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.291362 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1408/2854] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:49:31 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:31.295518 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816280c-9467-4d92-8919-a5398090d9bd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.307354 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816280c-9467-4d92-8919-a5398090d9bd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.380447 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.381041 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.381311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.381580 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.382238 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.384205 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.407873 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1447/2855] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:49:31 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:31.412216 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.423180 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5ca6e-e0d8-42d3-9477-40fb4232214a admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.429333 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.429971 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.430207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.430478 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.431125 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.432792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.444887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1409/2856] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:31.449877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.461079 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86bdaa-17c4-4dfa-8ff8-a496fa9a819c admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.466198 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.466851 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.467132 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.467408 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] PATH_INFO: `/v3/projects/aee58368507c4cb29d712ecae414c783/users/15c7ef5ee13446389ae8ccf644048982/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.482959 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee58368507c4cb29d712ecae414c783, user_id=15c7ef5ee13446389ae8ccf644048982, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.485670 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.504875 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1448/2857] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:31 2022] PUT /identity/v3/projects/aee58368507c4cb29d712ecae414c783/users/15c7ef5ee13446389ae8ccf644048982/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:31.509157 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.519385 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbf3dc-561c-4a70-ba33-d491c9ab1295 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.576102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06238c12-43ee-4def-a6bf-02a7c513a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.576708 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06238c12-43ee-4def-a6bf-02a7c513a10a admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.576983 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06238c12-43ee-4def-a6bf-02a7c513a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.577250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06238c12-43ee-4def-a6bf-02a7c513a10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.577877 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06238c12-43ee-4def-a6bf-02a7c513a10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.579466 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06238c12-43ee-4def-a6bf-02a7c513a10a admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.589588 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1410/2858] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:31.594092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.605325 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913623c-71ea-4173-aa26-4c7304745a98 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.610123 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.610778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.611061 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.611340 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] PATH_INFO: `/v3/projects/aee58368507c4cb29d712ecae414c783/users/15c7ef5ee13446389ae8ccf644048982/roles/a4580697b0c74e74a3503324e7660ef5` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.613381 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee58368507c4cb29d712ecae414c783, user_id=15c7ef5ee13446389ae8ccf644048982, role_id=a4580697b0c74e74a3503324e7660ef5)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.616078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.627035 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1449/2859] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:31 2022] PUT /identity/v3/projects/aee58368507c4cb29d712ecae414c783/users/15c7ef5ee13446389ae8ccf644048982/roles/a4580697b0c74e74a3503324e7660ef5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:31.637342 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.637741 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.638021 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.667253 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] MFA Rules not processed for user `15c7ef5ee13446389ae8ccf644048982`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:31.668495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:31.703703 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:31.750037 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1411/2860] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:31.761058 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.763173 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:31.775713 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:31.825990 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca9b4-5cbf-4ca8-99da-f9eb2fb28545 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.830137 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.830792 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.831191 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.831474 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.890984 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.892524 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.903762 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1450/2861] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:36.417416 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:36.418988 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:36.432527 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d15c6-1e91-4a80-a238-cb504011184b None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:36.436916 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd29a9-023c-4edb-96f1-85c92434c44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:36.437521 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd29a9-023c-4edb-96f1-85c92434c44d service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:36.437799 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd29a9-023c-4edb-96f1-85c92434c44d service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:36.438075 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd29a9-023c-4edb-96f1-85c92434c44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:36.447839 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd29a9-023c-4edb-96f1-85c92434c44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:36.449310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd29a9-023c-4edb-96f1-85c92434c44d service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:36.462211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1412/2862] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:41.403033 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:41.470158 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648f0f8-7037-4f9d-8236-7752543b6c67 service cinder] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:41.476152 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:41.476793 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:41.477078 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:41.477355 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] PATH_INFO: `/v3/users/a503979c828f4add9052cc8f42ed37bd` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:41.478605 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a503979c828f4add9052cc8f42ed37bd)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:41.480586 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:41.542763 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a503979c828f4add9052cc8f42ed37bd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:41.543566 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a503979c828f4add9052cc8f42ed37bd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:41.553673 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a503979c828f4add9052cc8f42ed37bd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:41.554448 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a503979c828f4add9052cc8f42ed37bd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:41.565414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a503979c828f4add9052cc8f42ed37bd'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:41.567856 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:41.587422 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1451/2863] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:49:41 2022] DELETE /identity/v3/users/a503979c828f4add9052cc8f42ed37bd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:41.592325 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:41.592941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:41.592941 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:41.614652 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:41.616035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:41.684784 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1413/2864] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:41.694923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:41.696672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:41.766125 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c130-19a1-4021-92e0-750b75225cea admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:41.770384 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:41.770945 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:41.771404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:41.772028 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:41.781645 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:41.783092 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:41.793505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1452/2865] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:42.071328 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.072889 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.089688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5db6-0c89-44ad-b899-69bba221a9b6 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:42.095412 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:42.096156 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.096426 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.096683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] PATH_INFO: `/v3/projects/159f200ff49f49fe9acae28ed2d8256f` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.097986 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=159f200ff49f49fe9acae28ed2d8256f)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:42.100990 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:42.158893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159f200ff49f49fe9acae28ed2d8256f', 'request_id': 'req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.167897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159f200ff49f49fe9acae28ed2d8256f', 'request_id': 'req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.174486 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159f200ff49f49fe9acae28ed2d8256f', 'request_id': 'req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.185977 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] The token cache is being invalidate because project 159f200ff49f49fe9acae28ed2d8256f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:49:42.186252 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.186999 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.188573 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1414/2866] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:49:42 2022] DELETE /identity/v3/projects/159f200ff49f49fe9acae28ed2d8256f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:42.192893 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.203211 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584db5fe-f867-4f15-8b21-042352a3b15f service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:42.265391 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:42.266043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.266320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.266594 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] PATH_INFO: `/v3/users/15c7ef5ee13446389ae8ccf644048982` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.267869 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c7ef5ee13446389ae8ccf644048982)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:42.269807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:42.326163 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c7ef5ee13446389ae8ccf644048982'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.326938 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c7ef5ee13446389ae8ccf644048982'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.336462 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c7ef5ee13446389ae8ccf644048982'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.337190 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c7ef5ee13446389ae8ccf644048982'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.346332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-d27cdd52-5e34-49d5-8f8a-ad358702e0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c7ef5ee13446389ae8ccf644048982'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.365057 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1453/2867] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:49:42 2022] DELETE /identity/v3/users/15c7ef5ee13446389ae8ccf644048982 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:42.675981 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.677453 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.692372 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe69bb-628c-4adc-8b83-a358aa1e5cce admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:42.732688 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:42.753102 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:42.753733 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.754009 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.754275 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] PATH_INFO: `/v3/projects/aee58368507c4cb29d712ecae414c783` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.755803 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee58368507c4cb29d712ecae414c783)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:42.757657 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:42.806030 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee58368507c4cb29d712ecae414c783', 'request_id': 'req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.815048 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee58368507c4cb29d712ecae414c783', 'request_id': 'req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.821456 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee58368507c4cb29d712ecae414c783', 'request_id': 'req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.831564 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] The token cache is being invalidate because project aee58368507c4cb29d712ecae414c783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:49:42.831882 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.832522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-da8c36cd-9ca2-495f-8ca5-be2bc84ed012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:49:42.834051 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1415/2868] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:49:42 2022] DELETE /identity/v3/projects/aee58368507c4cb29d712ecae414c783 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:42.840188 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaa6c1-cbb9-4eef-b561-005ecc5daca2 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.840667 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaa6c1-cbb9-4eef-b561-005ecc5daca2 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.840777 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaa6c1-cbb9-4eef-b561-005ecc5daca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.850870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:42.864031 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-87aaa6c1-cbb9-4eef-b561-005ecc5daca2 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:42.865396 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-87aaa6c1-cbb9-4eef-b561-005ecc5daca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.927778 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1454/2869] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:49:42.936522 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c8bc-e3b2-48ad-82c7-09dacd7b52a7 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.936808 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c8bc-e3b2-48ad-82c7-09dacd7b52a7 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.937084 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c8bc-e3b2-48ad-82c7-09dacd7b52a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.964848 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-4c81c8bc-e3b2-48ad-82c7-09dacd7b52a7 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:42.966087 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-4c81c8bc-e3b2-48ad-82c7-09dacd7b52a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.976186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1416/2870] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:49:42.980773 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaa6c1-cbb9-4eef-b561-005ecc5daca2 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.991421 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaa6c1-cbb9-4eef-b561-005ecc5daca2 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:42.997320 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:42.997914 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.998186 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.998451 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.999086 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81535) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:42.999392 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.001049 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.013493 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1455/2871] 10.222.0.88 () {58 vars in 1153 bytes} [Wed Aug 24 16:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.018141 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81c8bc-e3b2-48ad-82c7-09dacd7b52a7 None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.028605 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81c8bc-e3b2-48ad-82c7-09dacd7b52a7 None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.034793 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.035394 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.035711 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.035993 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.036599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.038557 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.071035 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1417/2872] 10.222.0.88 () {60 vars in 1153 bytes} [Wed Aug 24 16:49:43 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:43.076120 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.089546 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5846c4-3a4d-445d-8303-40b8de6f0e87 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.150106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.150689 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.150968 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.151235 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] PATH_INFO: `/v3/users` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.151887 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.153806 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.179159 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1456/2873] 10.222.0.88 () {60 vars in 1144 bytes} [Wed Aug 24 16:49:43 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:43.183626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.197722 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba983932-cb48-4d01-9e78-123ebe150880 admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.202903 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.203502 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.203812 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.204083 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.204720 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.206310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.216509 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1418/2874] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:49:43.220568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.230841 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb64f1e-d4bb-4bba-827a-aca8d8f78075 admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.235954 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b87a0-cd95-4e3b-a74b-e3a2b3250f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.236556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b87a0-cd95-4e3b-a74b-e3a2b3250f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.236833 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b87a0-cd95-4e3b-a74b-e3a2b3250f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.237110 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b87a0-cd95-4e3b-a74b-e3a2b3250f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.237767 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b87a0-cd95-4e3b-a74b-e3a2b3250f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.239420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b87a0-cd95-4e3b-a74b-e3a2b3250f0b admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.250537 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1457/2875] 10.222.0.88 () {58 vars in 1122 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:49:43.254674 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.266059 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c823-2bbf-47d7-b192-c9a8de8153dc admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.272918 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.273589 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.273868 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.274160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] PATH_INFO: `/v3/projects/860226f99dc24c589d5a4c1a0db66804/users/e68e1a0c1eb04d67a3ddd6f12b082655/roles/f264736e364b458eb3ef7842c6f5c982` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.289450 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=860226f99dc24c589d5a4c1a0db66804, user_id=e68e1a0c1eb04d67a3ddd6f12b082655, role_id=f264736e364b458eb3ef7842c6f5c982)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.292213 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.308364 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1419/2876] 10.222.0.88 () {60 vars in 1483 bytes} [Wed Aug 24 16:49:43 2022] PUT /identity/v3/projects/860226f99dc24c589d5a4c1a0db66804/users/e68e1a0c1eb04d67a3ddd6f12b082655/roles/f264736e364b458eb3ef7842c6f5c982 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:43.313480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14c3db-2c12-4b7a-9950-65e1b7c3678f None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.313765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14c3db-2c12-4b7a-9950-65e1b7c3678f None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.314036 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14c3db-2c12-4b7a-9950-65e1b7c3678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.340229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3c14c3db-2c12-4b7a-9950-65e1b7c3678f None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:43.341445 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3c14c3db-2c12-4b7a-9950-65e1b7c3678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:43.403255 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1458/2877] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:43.412875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.414978 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:43.476094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeeed1-f47c-40e8-96c8-3073078c62ab admin admin] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.479887 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.480488 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.480765 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.481033 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.490683 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.492178 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.501875 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1420/2878] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:49:44.158613 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059a5b-8a7b-471c-9bcf-18e0549791cc None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.159167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059a5b-8a7b-471c-9bcf-18e0549791cc None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.159167 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059a5b-8a7b-471c-9bcf-18e0549791cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.181051 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.190569 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b0059a5b-8a7b-471c-9bcf-18e0549791cc None None] MFA Rules not processed for user `e68e1a0c1eb04d67a3ddd6f12b082655`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:44.192434 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b0059a5b-8a7b-471c-9bcf-18e0549791cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:44.264180 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1459/2879] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:44.276425 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.278421 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:44.290661 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.343608 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e84c-88d2-4d23-a0cb-ae639ebfc6bf service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.347525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9bff3-676a-4e6e-a448-a78160bc725c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ef2398772541fa85ea0d46d6faf3d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.348162 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bff3-676a-4e6e-a448-a78160bc725c service cinder] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.349024 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bff3-676a-4e6e-a448-a78160bc725c service cinder] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.349288 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bff3-676a-4e6e-a448-a78160bc725c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.359338 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9bff3-676a-4e6e-a448-a78160bc725c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.360963 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9bff3-676a-4e6e-a448-a78160bc725c service cinder] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.370266 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1421/2880] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:49:45.842222 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:45.842831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:45.842831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:45.872420 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] MFA Rules not processed for user `e68e1a0c1eb04d67a3ddd6f12b082655`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:45.873637 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:45.881612 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1460/2881] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:49:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:49:54.366415 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=22 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:55.865846 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=30 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:10.175307 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62b0af-0b34-4e29-94f7-3147971ba25d None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.176335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62b0af-0b34-4e29-94f7-3147971ba25d None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.176335 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62b0af-0b34-4e29-94f7-3147971ba25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.210666 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-ed62b0af-0b34-4e29-94f7-3147971ba25d None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:10.212047 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-ed62b0af-0b34-4e29-94f7-3147971ba25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:10.221291 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1422/2882] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:50:10.240626 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.242305 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:10.326704 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291f9e-3102-4022-8950-94ff7e641f25 None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.333119 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.333726 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.334003 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.334272 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.342789 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:10.344652 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:10.358144 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1461/2883] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:13.264604 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd132-afbd-4ebe-969d-37a54258851b None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.265233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd132-afbd-4ebe-969d-37a54258851b None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.265233 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd132-afbd-4ebe-969d-37a54258851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.289186 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-df1dd132-afbd-4ebe-969d-37a54258851b None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:13.290463 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-df1dd132-afbd-4ebe-969d-37a54258851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:13.300702 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1423/2884] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 16:50:13.316032 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:13.317797 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:13.333934 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5d16-0a46-4986-91a3-04829e2a633e service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:13.340950 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:13.341557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.341821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.342093 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.350905 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:13.352538 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:13.362150 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1462/2885] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:16.574052 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92990f14-a9a1-4d2d-ae4a-a3c895403bee None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:16.574611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92990f14-a9a1-4d2d-ae4a-a3c895403bee None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:16.574611 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92990f14-a9a1-4d2d-ae4a-a3c895403bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:16.596185 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-92990f14-a9a1-4d2d-ae4a-a3c895403bee None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:16.597397 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-92990f14-a9a1-4d2d-ae4a-a3c895403bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:16.607646 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1424/2886] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:50:16.626062 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:16.637867 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd13486-59a0-41fa-a501-22d108db321d service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:16.645414 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:16.646030 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:16.646308 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:16.646568 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:16.655424 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:16.657672 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:16.667286 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1463/2887] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:19.684086 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.684626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.684626 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.709469 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:19.710744 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:19.720718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1425/2888] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:50:19.758037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:19.773404 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ac84f-3887-467d-b607-0feba162b9f0 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:19.780608 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b21a-412c-4d70-8d56-feb92e42e97a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:19.781208 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b21a-412c-4d70-8d56-feb92e42e97a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.781480 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b21a-412c-4d70-8d56-feb92e42e97a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.781752 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b21a-412c-4d70-8d56-feb92e42e97a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.790881 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669b21a-412c-4d70-8d56-feb92e42e97a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:19.792501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669b21a-412c-4d70-8d56-feb92e42e97a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:19.802292 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1464/2889] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:27.686492 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:27.688116 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:27.703226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f249-c646-41f4-85d3-1bd361bf88fc None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.707191 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.707828 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.708094 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.708366 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.710270 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:27.720781 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.722211 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.733764 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1426/2890] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:28.025138 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1c51-4a40-4b3c-b042-81de7d9836f3 None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.025923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1c51-4a40-4b3c-b042-81de7d9836f3 None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.025923 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f1c51-4a40-4b3c-b042-81de7d9836f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.046847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-aa8f1c51-4a40-4b3c-b042-81de7d9836f3 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:28.048373 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-aa8f1c51-4a40-4b3c-b042-81de7d9836f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:28.057598 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1465/2891] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:50:28.075202 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.091005 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f984-1347-4b7d-99f4-8f6c66a2c665 service neutron] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.096896 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.097513 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.097792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.098056 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.107207 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:28.108842 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:28.118515 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1427/2892] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:31.233246 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e8f5-0954-462a-99c7-3f7f106b91cd None None] REQUEST_METHOD: `POST` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.233824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e8f5-0954-462a-99c7-3f7f106b91cd None None] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.233824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e8f5-0954-462a-99c7-3f7f106b91cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.258565 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.auth.core [None req-3515e8f5-0954-462a-99c7-3f7f106b91cd None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81535) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:31.259831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-3515e8f5-0954-462a-99c7-3f7f106b91cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:31.269682 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1466/2893] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:50:31.289091 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.300915 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8614-2e1b-4abe-ad1e-b61390732bcd service nova] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.306643 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c79a6-6897-4d98-9f90-21cc23db6449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.307254 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c79a6-6897-4d98-9f90-21cc23db6449 service nova] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.307530 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c79a6-6897-4d98-9f90-21cc23db6449 service nova] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.308000 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c79a6-6897-4d98-9f90-21cc23db6449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.316900 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c79a6-6897-4d98-9f90-21cc23db6449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.318493 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c79a6-6897-4d98-9f90-21cc23db6449 service nova] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.328232 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1428/2894] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:40.807894 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515e8f5-0954-462a-99c7-3f7f106b91cd None None] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:40.815009 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=59 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:40.822607 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515e8f5-0954-462a-99c7-3f7f106b91cd None None] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:40.830590 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:40.831303 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:40.831556 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:40.831891 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:40.834629 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:40.850024 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:40.851695 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:40.864070 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1467/2895] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:41.323730 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=30 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.557778 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.558437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.558437 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.579507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] MFA Rules not processed for user `e68e1a0c1eb04d67a3ddd6f12b082655`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:45.580663 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:45.589250 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1429/2896] 10.222.0.88 () {58 vars in 958 bytes} [Wed Aug 24 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:50:45.828643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.838877 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b648980-c984-469a-a5f6-f7f5d9ab192a service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.843848 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fdb46b5aa2c477d8abce5a1eb9fb68d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.844449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.844725 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.844996 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.846957 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:45.857461 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.858966 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.867090 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1468/2897] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:46.220132 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:46.221718 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:46.299966 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee1ec-7c55-4405-b447-8617e5a0cf2a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:46.305139 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa1b51-e039-47d9-977c-51d59db095ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:46.305767 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa1b51-e039-47d9-977c-51d59db095ea service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.306054 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa1b51-e039-47d9-977c-51d59db095ea service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.306329 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa1b51-e039-47d9-977c-51d59db095ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.308225 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-65aa1b51-e039-47d9-977c-51d59db095ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:46.320650 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa1b51-e039-47d9-977c-51d59db095ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:46.322229 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa1b51-e039-47d9-977c-51d59db095ea service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:46.332154 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1430/2898] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:54.056514 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:54.077628 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a7bfa-b5c5-4a02-a84a-eafc2d9138a3 service neutron] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:54.084485 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:54.085095 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.085390 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.085697 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.087807 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:54.101106 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:54.102859 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:54.113994 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1469/2899] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:50:56.327792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=35 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.747276 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc2bd-6b76-4d62-a343-c533ba059fe8 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.748386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc2bd-6b76-4d62-a343-c533ba059fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.748386 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc2bd-6b76-4d62-a343-c533ba059fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.772392 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-2d1cc2bd-6b76-4d62-a343-c533ba059fe8 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:57.774621 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-2d1cc2bd-6b76-4d62-a343-c533ba059fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:57.789249 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1431/2900] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:50:57.804578 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.816571 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d87cc-f462-4ccc-a254-2e511bbe0150 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.823349 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.823998 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.824256 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.824535 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.833449 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.835042 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.844765 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1470/2901] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:51:01.048912 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbc37f-0ebb-4cba-b3dd-8307bdee9e37 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.049487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbc37f-0ebb-4cba-b3dd-8307bdee9e37 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.049487 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbc37f-0ebb-4cba-b3dd-8307bdee9e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.074860 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-22bbc37f-0ebb-4cba-b3dd-8307bdee9e37 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:01.076098 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-22bbc37f-0ebb-4cba-b3dd-8307bdee9e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:01.085633 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1432/2902] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:51:01.100343 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.113112 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedffae-9539-4ee1-908f-9865d56f2e38 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.121043 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.121643 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.121919 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.122187 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.131387 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:01.133037 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:01.142910 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1471/2903] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:51:04.152286 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6afd4-6afc-4833-8c74-7c98bf51cd38 None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.152849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6afd4-6afc-4833-8c74-7c98bf51cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.152849 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6afd4-6afc-4833-8c74-7c98bf51cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.177210 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-aae6afd4-6afc-4833-8c74-7c98bf51cd38 None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:04.178507 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-aae6afd4-6afc-4833-8c74-7c98bf51cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:04.188444 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1433/2904] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:51:04.204824 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.217554 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022048b1-7c75-4eb2-ad3f-091eef0f1779 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.224557 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.225141 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.225573 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.225847 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.234710 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.236326 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.246140 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1472/2905] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 16:51:07.329199 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e17a88-4012-47b2-98f5-423c5cae4caa None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.329721 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e17a88-4012-47b2-98f5-423c5cae4caa None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.329897 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e17a88-4012-47b2-98f5-423c5cae4caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.350375 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-e4e17a88-4012-47b2-98f5-423c5cae4caa None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:07.351599 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-e4e17a88-4012-47b2-98f5-423c5cae4caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:07.361127 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1434/2906] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:51:07.378248 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.391482 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376001fc-8457-4c69-b37d-32a2e872d80d service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.397245 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:07.398185 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.398460 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.398724 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.407348 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:07.408961 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:07.418941 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1473/2907] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:51:10.527310 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff2d6-cc0f-4710-bcc6-1dac9c464f3a None None] REQUEST_METHOD: `POST` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.527927 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff2d6-cc0f-4710-bcc6-1dac9c464f3a None None] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.528108 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff2d6-cc0f-4710-bcc6-1dac9c464f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.552686 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.auth.core [None req-873ff2d6-cc0f-4710-bcc6-1dac9c464f3a None None] MFA Rules not processed for user `2d40cc5420f2410681feb8bd4176552c`. Rule list: `[]` (Enabled: `True`). {{(pid=81534) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:10.553893 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-873ff2d6-cc0f-4710-bcc6-1dac9c464f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:10.563495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1435/2908] 10.222.0.73 () {58 vars in 1016 bytes} [Wed Aug 24 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 16:51:10.606769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.619263 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e9208-b673-4566-9743-cc2bddc22198 service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.625845 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff19f92d804245ba908c5609bd133ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.626444 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.626699 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.627021 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.635562 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.637229 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.647064 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1474/2909] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:51:20.547762 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=15 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.643060 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=47 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:38.946160 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff2d6-cc0f-4710-bcc6-1dac9c464f3a None None] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:38.961698 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff2d6-cc0f-4710-bcc6-1dac9c464f3a None None] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.967904 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.968525 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] REQUEST_METHOD: `GET` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.968790 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.969063 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.971242 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.fernet_utils [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81534) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:38.983947 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.985602 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.996422 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1436/2910] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:51:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:51:39.014831 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:39.025216 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fded88-33cf-4965-acee-dcb40456a7ab service nova] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:39.031505 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:39.032332 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:39.032501 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:39.032769 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] PATH_INFO: `/v3/users/e68e1a0c1eb04d67a3ddd6f12b082655` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:39.033882 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68e1a0c1eb04d67a3ddd6f12b082655)` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:39.035821 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:39.091901 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68e1a0c1eb04d67a3ddd6f12b082655'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.092587 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68e1a0c1eb04d67a3ddd6f12b082655'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.100199 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68e1a0c1eb04d67a3ddd6f12b082655'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.101007 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68e1a0c1eb04d67a3ddd6f12b082655'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.111379 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.notifications [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68e1a0c1eb04d67a3ddd6f12b082655'} {{(pid=81535) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.129871 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1475/2911] 10.222.0.88 () {58 vars in 1224 bytes} [Wed Aug 24 16:51:39 2022] DELETE /identity/v3/users/e68e1a0c1eb04d67a3ddd6f12b082655 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:51:39.333001 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] Authenticating user token {{(pid=81534) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:39.344398 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988917f9-e8c0-4415-a0f8-45350a8c7292 service placement] Validating token access rules against request {{(pid=81534) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:39.405316 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d40cc5420f2410681feb8bd4176552c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11fe830f962e44849f43a8ae423c5eae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81534) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:39.405946 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:39.406226 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:39.406495 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] PATH_INFO: `/v3/projects/860226f99dc24c589d5a4c1a0db66804` {{(pid=81534) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:39.407761 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=860226f99dc24c589d5a4c1a0db66804)` {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:39.409680 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] RBAC: Authorization granted {{(pid=81534) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:39.458869 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860226f99dc24c589d5a4c1a0db66804', 'request_id': 'req-03afa622-63a5-43b0-bdc1-194ff596cadc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.468653 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860226f99dc24c589d5a4c1a0db66804', 'request_id': 'req-03afa622-63a5-43b0-bdc1-194ff596cadc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.475179 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860226f99dc24c589d5a4c1a0db66804', 'request_id': 'req-03afa622-63a5-43b0-bdc1-194ff596cadc'} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.485850 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] The token cache is being invalidate because project 860226f99dc24c589d5a4c1a0db66804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81534) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 16:51:39.486138 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.486792 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG keystone.notifications [None req-03afa622-63a5-43b0-bdc1-194ff596cadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81534) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 16:51:39.488343 dv-cinder-852208-9-smb devstack@keystone.service[81534]: [pid: 81534|app: 0|req: 1437/2912] 10.222.0.88 () {58 vars in 1233 bytes} [Wed Aug 24 16:51:39 2022] DELETE /identity/v3/projects/860226f99dc24c589d5a4c1a0db66804 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:51:49.126547 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:49.483117 dv-cinder-852208-9-smb devstack@keystone.service[81534]: DEBUG dbcounter [-] [81534] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:32.889311 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Authenticating user token {{(pid=81535) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:32.891352 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:32.971053 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfa863-65a5-4d29-b25c-de10699e388a admin admin] Validating token access rules against request {{(pid=81535) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:33.040261 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057ef27-af20-43b3-aa5c-2d979710d418 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fe69ee335b461fbfa55620f104beb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f928809858b64247862a3901925f8a43', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81535) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:33.040870 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ef27-af20-43b3-aa5c-2d979710d418 service placement] REQUEST_METHOD: `GET` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:33.041151 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ef27-af20-43b3-aa5c-2d979710d418 service placement] SCRIPT_NAME: `/identity` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:33.041454 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ef27-af20-43b3-aa5c-2d979710d418 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81535) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:33.043365 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.fernet_utils [None req-9057ef27-af20-43b3-aa5c-2d979710d418 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81535) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:33.055398 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057ef27-af20-43b3-aa5c-2d979710d418 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:33.057080 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057ef27-af20-43b3-aa5c-2d979710d418 service placement] RBAC: Authorization granted {{(pid=81535) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:33.067164 dv-cinder-852208-9-smb devstack@keystone.service[81535]: [pid: 81535|app: 0|req: 1476/2913] 10.222.0.88 () {60 vars in 1365 bytes} [Wed Aug 24 16:52:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 16:52:43.063063 dv-cinder-852208-9-smb devstack@keystone.service[81535]: DEBUG dbcounter [-] [81535] Writing DB stats keystone:SELECT=58 {{(pid=81535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}